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The  Army  Research  Institute  (ARI)  Presidio  of  Monterey  Field  Unit  is  con¬ 
cerned  with  research  related  to  improving  unit  collective  training.  Research 
in  this  area  is  conducted  under  the  sponsorship  of  the  U.S.  Army  Training 
Board  (ATB)  and  the  U.S.  Army  Combined  Arms  Center  (CAC).  The  National  Train¬ 
ing  Center  (NTC)  uses  an  instrumentation  system  to  provide  valuable  detailed 
information  about  unit  collective  training.  To  capitalize  on  this  valuable 
information,  the  Presidio  of  Monterey  Field  Unit  has  acquired  the  capability 
of  replaying  and  analyzing  NTC  data.  The  collection  and  analysis  of  this 
dynamic  and  complex  data  breaks  new  ground.  The  development  and  adaption  of 
methodological  tools  for  the  analysis  of  such  data  are  required.  This  report 
is  an  in-house  effort  that  reviews,  evaluates,  and  develops  times-series  meth¬ 
odologies  that  can  be  applied  to  NTC  data  and  other  complex  Army  environments. 
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INTERACTIVITY  THEORY:  ANALYZING  HUMAN  ENVIRONMENTS  USING  LINEAR 

PREDICTION  FILTERS 


EXECUTIVE  SUMMARY 


Requirement: 

The  ability  to  analyze  the  details  of  Army  unit  performance  quantitatively 
is  important  for  many  scientific  and  practical  applications.  Performance  is 
used  in  a  general  sense  to  refer  both  to  tactical  behavior  during  field  training 
exercises,  and  to  day-to-day  operations  in  garrison.  The  analysis  of  performance 
in  such  realistic  Army  environments  is  complex.  It  involves  the  analysis  of 
dynamic  forms  of  interaction  over  time  between  individuals  and  groups,  and  be¬ 
tween  groups.  In  addition.  Army  environments  are  not  tightly  controlled,  and 
unexpected  random  events  are  commonplace.  Approximate  methods  are  needed  to 
analyze  performance  quantitatively  in  these  circumstances. 


Procedure: 

Analyses  of  complex  interactive  human  environments  pose  analytic  diffi¬ 
culties  for  commonly  used  methods.  Linear  prediction  filters  are  selected  as 
a  methodology  that  can  realistically  reflect  the  characteristics  of  an  inter¬ 
active  environment  and  conform  to  appropriate  scientific  criteria:  empiricism, 
replication,  prediction,  and  parsimony.  Filters  are  compared  to  related 
linear  models  (e.g.,  ANOVA,  path  analysis).  Scientific  criteria  are  used  to 
identify  weaknesses  in  interactive  applications  of  traditional  linear  methods. 
A  multichannel  linear  prediction  filter  is  derived  and  integrated  with  a  mea¬ 
surement  model,  producing  "time-series"  factor  analysis.  The  model  is  applied 
to  data  showing  a  long-term  cyclical  relationship  between  promotion  rates  in 
the  U.S.  Army  and  survey  measures  of  company  effectiveness. 


Findings: 

Multichannel  linear  prediction  filters  provide  a  useful  set  of  methods 
that  can  be  applied  to  the  analysis  of  Army  unit  performance  in  dynamic  environ¬ 
ments.  These  filters  are  useful  for  predicting  the  dynamics  of  garrison  per¬ 
formance  as  is  shown  in  the  Army  example  that  is  provided. 


Utilization  of  Findings: 

The  National  Training  Center  (NTC)  uses  a  sophisticated  automated  data 
acquisition  system  to  record  events  over  time  for  NTC  exercises.  Another 
possible  application  of  linear  prediction  filters  is  for  the  analyses  of  such 
data.  In  addition,  the  filters  can  be  used  usefully  to  simulate  the  dynamics 
of  battle  in  computer -driven  "battle"  simulations. 
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INTERACTIVITY  THEORY:  ANALYZING  HUMAN  ENVIRONMENTS  USING  LINEAR 

PREDICTION  FILTERS 


The  application  of  the  scientific  method  in  psychological  research 
has  been  the  subject  of  continuing  debate  (see  Elms,  1975;  Gergen,  1973, 
1976;  Greenwald,  1976b;  Schlinker,  1976;  Secord,  Note  1).  Some  critics 
have  asserted  that  the  application  of  the  scientific  method  has  been 
inadequate.  As  a  consequence,  informational  content  in  the  field 
becomes  ideologically  based,  since  theories  remain  untested  by  the 
scientific  method.  Far  from  being  upset  by  ideological  content,  some 
psychologists  have  urged  the  creation  of  informational  content 
"liberated  both  from  the  press  of  immediate  fact  and  the  necessity  for 
verification."  The  application  of  emprirical  methods  to  psychological 
problems  Is  seen  as  inappropriate.  The  psychologist  thus  becomes 
liberated  from  the  necessity  for  "discompassionate  comportment  in 
scientific  affairs"  (Gergen,  1978,  p.  1344,  1982). 

SCIENTIFIC  METHOD 

By  contrast,  we  argue  that  ideologically  based  content  in  psychology 
is  neither  necessary  or  desirable  when  a  more  vigorous  application  of  the 
scientific  method  can  move  informational  content  beyond  ideology. 
Interactivity  theory  is  directed  toward  the  goal  of  improving  the  appli¬ 
cation  of  the  scientific  method  in  psychological  research.  The  meaning  of 
"scientific  method"  as  used  here  is  not  synonymous  with  "randomization" 
or  "controls"  in  a  typical  application  of  the  experimental  paradigm.  In 
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fact,  we  argue  (see  Section  l.l.)  that  some  applications  of  the  traditional 
experimental  paradigm  in  psychology  can  actually  be  poor  applications  of 
the  scientific  method.  A  simplified  diagram  of  some  essentials  of  the 
scientific  method  appears  in  Figure  l.  To  briefly  summarize,  the 
epistemology  of  the  scientific  method  is  empiricism,  i.e. ,  testing  theory 
using  systematic  observation.  The  objective  of  the  scientific  method  is 
to  modify  theory  to  match  data.  As  noted  in  Figure  1,  correspondence  is 
required  between  the  predictions  that  stem  from  theory  and  the  predic¬ 
tions  that  stem  from  the  application  of  the  methodology.  If  this 
correspondence  does  not  exist,  "something"  may  be  tested  but  it  is  not 
the  theory  in  question.  In  addition,  the  methodology  must  be  capable  of 
making  predictions  in  the  first  place  so  that  theory  becomes  subject  to 
testing  and  modification.  Given  equally  precise  prediction,  concise 
representations  are  always  preferred  over  inconcise  ones  (law  of  parsi¬ 
mony,  or  Occam's  razor).  Predictions  that  are  confirmed  should  be 
replicable.  These  well  known  principles  delineate  the  areas  where 
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Figure  1.  Some  essentials  of  the  scientific  method. 
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problems  can  arise  in  the  application  of  the  scientific  method  (see 
Sections  1.3.,  2.1.3.,  3.3.4.).  The  goal  of  Interactivity  theory  is  to 
adhere  to  the  principles  of  the  scientific  method  in  these  potential 
problem  areas,  i.e.,  require  (a)  empiricism,  (b)  replication,  (c)  pre¬ 
diction,  and  (d)  parsimony.  These  four  scientific  criteria  were  used  as 
guidelines  for  methodological  development  and  evaluation.  Subsequent 
discussion  is  organized  in  these  terms. 

The  relationships  between  these  criteria  are  important  since 
conclusions  drawn  from  them  can  be  in  conflict.  When  conflict  exists 
among  objectives,  the  relationship  between  objectives  is  defined  by  the 
concept  of  preemptive  prioritization — a  concept  borrowed  from  goal 
programming.  In  goal  programming,  the  analyst  must  satisfy  multiple 
mutually  contradictory  objectives  by  satisfying  some  ahead  of  others  in 
order  of  a  preestablished  priority  structure.  An  implicit  priority 
structure  exists  among  the  scientific  criteria:  in  order  of  priority, 

(a)  empiricism,  (b)  replication,  prediction  (placed  together  as  related 
criteria)  and  (c)  parsimony.  When  conflict  exists  among  criteria, 
empiricism  must  be  ordered  ahead  of  prediction  so  that  theory  can  be 
tested  by  prediction.  Empiricism  requries  observations  to  be  made 
according  to  theory  even  if  forecasts  are  not  optimal  under  these 
conditions,  because  the  lack  of  optimality  provides  a  criterion  for 
modifying  theory.  Parsimony  involves  refusing  to  multiply  complexity 
beyond  necessity.  However,  empiricism,  prediction,  and  replication 
constitute  necessities.  Simplicity  cannot  be  obtained  at  the  expense  of 
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empricislm,  prediction  or  replication,  without  engaging  in  over  simplifi¬ 
cation  or  false  parsimony.  For  these  reasons  parsimony  is  ordered  last. 

1.  Empiricism 

1.1.  Bootstrapping  Levels  of  Theory 

Interactivity  theory  is  partitioned  into  three  levels  of  theoty 
with  three  corresponding  levels  of  methodology  in  Figure  1.  The  hier¬ 
archical  organization  of  levels  indicates  a  dependence  of  upper  levels 
of  theory  upon  lower  levels.  These  same  levels  of  theory  exist  in  the 
physical  sciences.  However,  in  the  physical  sciences,  the  lower  levels 
can  be  so  straightforward  that  they  become  transparent  to  observers. 
Transformational  theory  is  theory  about  change,  i.e. ,  what  it  takes  to 
transform  units  of  analysis  from  their  present  state  to  a  new  state  as 
defined  by  predetermined  goals.  Such  transformational  questions  are 
logically  dependent  upon  historical  theory,  which  describes  present 
states  in  terms  of  past  histories  of  the  units  of  analysis.  Historical 
theory,  in  turn,  is  dependent  on  a  measurement  theory  that  describes 
needed  measurements  and  how  to  combine  them  in  order  to  track  appropriate 
"historical"  variables.  To  recap,  transformational  theory  cannot  be 
tested  without  identifying  current  states  first.  Current  states  cannot  be 
identified  outside  the  context  if  their  own  histories,  and  histories 
cannot  be  tracked  without  measuring  relevant  variables  first. 

Empiricism  requires  that  theory  be  tested  at  all  levels.  The  only  way  to 
accomplish  this  is  to  test  theory  from  the  bottom  up,  from  measure¬ 
ment  theory  through  historical  to  transformational  theory,  in  a  bootstrap 
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fashion.  Transformational  theory  cannot  be  tested  prior  to  testing 


historical,  and  measurement  theory;  likewise,  historical  theory  cannot 
be  tested  prior  to  measurement  theory.  Violating  this  order  violates 
the  principle  of  empiricism,  and  produces  information  that  relies  on  a 
poor  foundation.  In  psychology,  it  is  generally  much  more  difficult  to 
bootstrap  through  lower  levels  of  theory  than  in  the  physical  sciences. 
Moreover,  psychological  theory  (see  Neel,  1977,  for  examples  of  theories) 
is  frequently  most  elaborate  at  the  transformational  level  and  most 
sparce  at  the  measurement  levels — a  situation  Incompatible  with  empiricism. 
The  goal  of  interactivity  theory  is  to  adhere  to  empiricism  by  providing 
tools  that  allow  observations  to  be  made  at  all  levels  of  theory.  Almost 
by  definition,  this  approch  is  data  intensive,  requiring  appropriate 
observations  at  all  levels.  Initial  emphasis  is  in  measurement  and 
historical  models. 

1.2.  Correspondence  of  Theory  and  Method 

Besides  ignoring  the  necessity  for  bootstrapping,  a  second  common 
way  to  violate  the  principle  of  eiq>iricism  is  to  mismatch  theory  and 
method  as  depicted  in  Figure  1.  If  the  predictions  provided  by  theory 
don't  correspond  directly  to  their  realization  through  the  method, 
"something"  may  be  tested  but  it  is  not  the  theory  in  question.  If  the 
theory  in  question  is  not  tested,  the  principle  of  empiricism  has  been 
violated.  Instantiation  is  a  descriptive  term,  borrowed  from  computer 
science  terminology,  that  is  used  here  to  refer  to  this  process  of 
matching  method  to  theory.  Theory  is  like  an  inactive  generic  template. 


Methodology  must  correctly  activate  specific  instances  of  the  theory. 

The  process  of  correctly  activating  instances  is  called  instantiation. 
Methodology  must  correctly  instantiate  theory. 

Interactivity  theory  approaches  the  issue  of  instantiating  theory 
by  first  defining  generic  characteristics  of  theory  to  which  the  methods 
can  be  applied.  Interactivity  theory  was  designed  to  apply  to  inter¬ 
active  human  environments: 

The  human  environment  can  be  characterized  by 
complex,  recursive,  nonlinear,  time -dependent 
exchanges  between  interacting  people  or  groups. 

Interaction  between  participants  is  selective 
and  goal  oriented.  The  course  of  interaction 
adapts  to  fit  circumstances;  which  can  Include 
random  events.  Interaction  occurs  in  a  context 
of  social  groups,  organizations  or  institutions. 

This  generic  characterization  of  the  human  environment  is  the 
starting  point  for  Interactivity  theory.  This  starting  point  appears 
to  be  realistic  and  compatible  with  many  psychological  theories.  The 
problem  next  becomes  one  of  matching  methods  to  the  definition  of  the 
environment  that  will  not  violate  the  Integrity  of  the  initial  defini¬ 
tion.  Linear  prediction  filtering  (digital  filtering)  was  selected  as  a 
technique  that  provides  an  appropriate  match  to  the  problem  as  defined 


above.  These  filters  are  used  In  many  high  technology  applications.  To 
a  large  extent,  the  literature  related  to  this  approach  is  found  outside 


psychology,  e.g. ,  in  the  economics,  electronics  engineering,  and 
statistics  literature  (see  Chow,  1975,  1981;  Friedlander,  1982a,  1982b, 
1983;  Isaksson,  Wennberg  &  Zetterberg,  1981;  Jain,  1981;  Kay  &  Marple, 
1981).  Many  concepts  differ  from  traditional  deterministic  concepts 
commonly  found  in  psychology.  Some  familiarity  with  such  models  is 
necessary  as  a  point  of  departure  for  further  discussion.  An  example  of 
a  multichannel  linear  prediction  filter  is  provided  next. 

1.2.1  Multichannel  linear  prediction  filter.  The  model  is  a 
multivariate  generalization  of  the  autoregressive  time-series  model  (see 
Chow,  1975,  chap.  3).  The  definition  of  the  model  starts  with  model 
statements  which  define  the  linear  relations  between  each  variable  at 
time  t_,  and  its  own  history  and  the  histories  of  all  other  variables,  as 
measured  at  equidistant  and  discrete  points  in  past  time.  For  example, 
model  statements  for  a  two-variable  two-wave  panel  design  can  be  written, 

+  ±12  *1-1  +  ±xt 

yi  "  -21  *1-1  *  —22  ft-1  +  % 

where  jc,  are  measured  variables,  subscripts  _t-l  are  the  times 
associated  with  measurement  Intervals,  are  real  linear  coefficients 
showing  relationships  from  past  to  present,  and  £xt,  eyt  represent 


random  residuals,  or  white  noise  processes.  Likewise,  Che  model  state- 


aent  for  a  two  variable,  three-wave  design  can  be  written, 

\  "  in  Vi  +  ±12  *1-2  +  hr*  +  *21 

’  -2 1  Vl  *  ±22  *t-»  *  “23  ±t-2  +  ±24  fc-2  + 


(3) 


The  model  statement  can  be  written  in  the  sane  way,  as  illustrated 
above,  for  both  tine-series  and  panel  designs.  With  tine-series  many 
observations  on  a  single  case  vary  by  tine,  while  in  panel  designs,  nany 
cases  are  observed  at  Just  a  few  tine  intervals.  The  algebra  is  greatly 
simplified,  if  the  model  statement  is  rewritten  in  matrix  notation  as  a 
first-order  difference  equation.  Only  a  single  time  lag  appears  in  a 
first-order  equation.  Since  Equation  2  ‘already  has  just  one  time  lag, 
it  translates  directly  into  first  order  form  as, 


Since  more  than  one  time  lag  appears  in  the  second  model  statement,  it 
must  be  rewritten  as, 


(5) 


0  1.0  0  0 


0 


Equations  4  and  5  can  be  written  more  compactly  in  first  order  form  as. 


X  ■  AX.,  i  +  v,.,  where 

Xt  is  a  n  x  n  matrix  of  observed  variables  (starting  at  time  t),  with  jg, 
means.  The  term  jn  represents  the  number  of  observations.  The  term 
n.  -  £  x  £ .  The  term  £  is  defined  as  the  number  of  variables  in  the  system  at 
time  and  is  the  number  of  lagged  observations  on  these  variables,  e.g.  , 

£  *  1  in  Equation  2  and  £  «  2  in  Equation  3.  The  value  t_  represents  the  order 
of  the  equation.  It  should  be  noted  that,  in  time  series  designs,  the  data 
matrix  is  transposed  from  the  position  typically  given  in  a  linear  regression 
set-up.  In  addition,  in  order  to  simplify  the  notation.  It  is  assumed  that 
the  observed  variables  have  been  scaled  by  a  factor  of  1/m5*,  so  that 
covariance  matrixes  can  be  represented  in  the  form  XtX',  without  requiring 
division  by  m.  A  is  an  n  x  n  matrix  of  real  linear  coefficients  (e.g.,  as 
shown  in  Equations  4  and  S).  Xt_ j  is  a  n  x  o  matrix  of  observed  variables 
listed  at  time  £-1  in  relation  to  X£.  The  vector  v£  is  a  £  x  b  matrix  of 
random  moise  variables,  uncorrelated  with  Xt_j,  with  0^  means  (see,  e^,  in 
Equations  4  and  S).  When  t  is  greater  than  one,  v  will  contain  some  zero 
elements.  It  is  clear  that  the  pattern  in  Equations  5  and  6  readily 
generalizes  to  model  statements  with  any  number  of  variables  and  lags  (see 
Chow,  1975,  chap.  3). 

Time  is  given  by  t_,  a  counter  that  increases  with  time.  Measurement  lags 
are  given  by  Jt,  a  counter  measured  in  relation  to  t_  that  increases  backward  in 
time  from  the  starting  value  of  0  assigned  at  t.  Synchronous  relationships 
include  only  those  measured  at  a  common  time,  with  1c  -  0.  The  expected 


variance-covariance  matrix  between  variables  in  synchronous  time,  can  be 
written  as  a  function  of  A  and  v  in  Equation  6  as  follows: 

r/t  ■  E  (Xlt  X:.)  -  V  +  AVA'  +  A2VA'2  + _ A^VA'i.'1,  where 

the  observed  variables  JC^t,  are  ®xPr®ssed  as  deviations  from  their 

means,  and  q  is  a  portion  of  the  expected  variance-covariance  matrix  at 

time  lag  k_  ■  0.  r^t  qj  includes  n^  x  n^  covariances  between  those  observed 

variables  listed  at  the  left  in  Equations  4,  5,  and  6.  K,  is  the  matrix  of 

real  coefficients  from  Equation  6.  V  „  is  the  variance-covariance  matrix 

-*n  x  _n 

of  the  vector  of  residual  noises  from  Equation  6.  Derivation  of  Equation  7 
is  provided  in  Chow  (1975,  chap.  3)  and  will  not  be  repeated  here.  In  the 
derivation  ot  Equation  7,  covariation  between  residuals  is  not  permitted 
across  time,  anytime  k_  >  0.  However,  covariation  between  residuals  is 
permitted  if  it  occurs  in  synchronous  time  ( It  »  0).  The  V^matrix  contains, 
then,  variances  of  the  residual  noises  for  each  variable.  The  pattern  of 
covariances  between  residuals  must  be  zero  for  lagged  relationships  (k^  ■  0) 
but  may  differ  from  zero  for  synchronous  relationships.  Techniques  for 
eliminating  auto-correlated  residuals  are  not  discussed  here  (see  Chow,  1975, 
pp.  61-63).  Equation  7  is  an  infinite  series.  If  the  time-series  is 
stationary  (see  discussion  of  statlonarity  in  Sections  2.2.1.),  the  series 
reaches  a  steady  state  as  time  (denoted  by  t_  in  Equation  7)  goes  to  infinity, 
and  additional  terms  on  the  right  of  Equation  7  become  negligible. 


The  expected  covariance  matrix  involving  Lagged  relationships,  Jc  >  0,  is 


% 
m 


obtained  by, 


r(t_,k_  “  1  yktSjtHc*  “  £  r(t,0)  * 


where 


(8) 


T(t  is  the  n^  x  t\  section  of  the  covariance  matrix  involving  time  at 

lag  k_  1.  When  It  ■  1,  I^t  involves  the  covariances  between  variables  at 

XtX'  r  Additional  n^  x  £  sections  of  the  covariance  matrix  can  be  projected 
backward  in  time  as  jt  increases,  Jt  >  1. 

It  is  clear  from  Equation  8  that  k  can  be  calculated  from  the  observed 
n  x  n  sections  of  the  covariance  matrix. 


-1 


&  "  r(l)  r(0)  * 


(9) 


In  order  to  make  the  notation  more  concise,  ^  has  been  deleted  from  ,  in 

Equation  (9)  and  subsequent  equations.  and  must  be  stationary  in 

this  model. 

V  can  be  calculated  by  eliminating  the  infinite  series  from  Equation  7. 
This  is  accomplished  by  premultiplying  Equation  7  by  A^and  post-multiplying  it 
by  A"  which  yields. 


*  ><0)  i'  ■  «4'  +  iV2  ♦ 


ao> 


Subtracting  Equation  10  from  Equation  7  eliminates  the  infinite  series,  and 
provides  an  expression  for  V : 

I(*>  ’  r<0)  -  i,  r<0 >£•  <ll) 

An  alternate  expression  for  Equation  11,  in  summation  notation,  is  useful  for 
purposes  of  compact  calculation: 


1 1 


n  n 

'-*'12 

£• 1  k-1 

n  is  defined  as  in  Equation  6,  and  elements  of  A,  r/n\ ,  and  V  are 

—  m  vU)  4M 

represented  by  £,  Y^q)  *  an<*  — *  resPectively . 

Given  an  observed  stationary  covariance  matrix,  A  can  be  calculated 

t m 

first  from  Equation  9,  and  V  can  be  calculated  next  from  Equations  11 
or  12.  To  close  the  loop,  A^  and  can  be  substituted  into  Equations  7 
and  8,  and  the  original  covariance  matrix  can  be  regenerated  exactly 
from  A  and  V. 

AM  AM 

Equation  7  includes  infinite  series  to  generate  .  This  is  not 
a  particularly  efficient  way  to  compute  .  Appendix  A  provides 
alternate  computational  procedures. 

1.2.2.  Filter  characteristics.  The  model  just  outlined  represents 
a  multichannel,  finite,  impulse-response  (FIR)  filter  for  zero-mean 
processes.  Estimates  are  equivalent  to  estimates  from  simple  multi¬ 
variate  regression  computed  on  stationary,  block  Toeplltz  matrices  (see 
Section  2.1.1.).  The  regression  is  multivariate  in  a  dual  sense  with 
multiple  dependent  as  well  as  independent  variables.  The  logic  under¬ 
lying  a  filtering  model  differs  in  a  variety  of  ways  from  a  deterministic 
regression  model,  however.  In  a  deterministic  regression  equation,  the 
regression  coefficient  represents  the  degree  of  deterministic  input  from 
"independent"  variables,  and  "error"  represents  the  lack  of  perfect 
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,  where 


(12) 


control.  By  contrast,  In  a  filtering  model,  the  stochastic  white  noise 
parameters  (i.e.,  "error")  represent  the  input  that  drives  the  system. 
Without  the  driver  the  system  would  die.  Activation  of,  or  driving 
energy  for,  a  stochastic  system  must  always  come  from  sourc  i  that  are 
at  least  partly  stochastic  (i.e.,  random).  By  contrast,  in  a  deter¬ 
ministic  model,  activation  or  energy  comes  from  entirely  deterministic 
sources.  In  a  stochastic  system,  the  random  driver  feeds  two  types  of 
processes:  a  colored  (i.e.,  correlated)  noise  process  that  in  turn 
feeds  into  an  "autoregression"  process.  Together  these  processes 
produce  filtered  output — containing  structure — from  white  noise  as 
input . 

This  concept  underlies  the  multivariate  ARMA  model  (see  Box  & 
Jenkins,  1976;  Granger  6  Newbold,  1977).  In  this  model,  white  and 
colored  noise  processes  drive  filter  coefficients  (autoregression,  AR, 
parameters)  producing  filtered  output.  Moving  average  (MA)  parameters 
are  associated  with  colored  noise  processes.  A  wide  variety  of  physical 
and  biological  systems  can  be  modeled  in  this  way  (Kay  &  Marple,  1981). 
The  model  in  this  section  is  a  special  case  of  an  ARMA  model.  The  model 
is  a  special  case  because  colored  noise  is  limited  to  synchronous  time. 
The  Information  is  partitioned  so  that  all  information  that  is  useful 
for  forecasting  is  contained  in  A,  the  matrix  of  "autoregressive" 
coefficients,  while  all  information  about  the  noise  processes  that  drive 
the  system  is  contained  in  J/.  In  a  filtering  model,  if  a  particular 
process  produced  structure  in  data,  the  same  process  should  be  able  to 


decompose  it,  reducing  residuals  to  white  noise. 

In  the  general  case,  iterative  numerical  techniques  are  required  to 
estimate  ARMA  parameters  (see  Granger  &  Newbold,  1977).  However,  in  the 
special  case  just  noted,  A  and  V  parameters  can  be  estimated  in  closed 

Mm  mm 

form  using  least  squares  estimators.  In  addition,  the  least  squares 
estimators  in  the  special  case  are  also  maximum  likelihood  estimators. 

A  stationary  process  (see  Section  2.1.1.)  can  be  written  in  first  order 
form  as  in  Equation  6,  and  considered  to  follow  a  Markov  process. 

According  to  the  Gaus-Markov  theorem,  least  squares  estimators  are  also 
maximum  likelihood  (minimum  variance)  estimators  under  these  circum¬ 
stances  (Wilks,  1962,  pp.  283-286). 

Filters  as  in  Section  1.2.1.  provide  a  number  of  useful  features 
for  modeling  social  interaction.  In  psychology,  theoretical  relation¬ 
ships  are  frequently  stated  in  terms  of  discrete  linear  relationships. 
Parameters  A  and  V  provide  a  useful  form  for  instantiating  many  theories. 

4m  am 

In  addition,  features  can  be  modeled  with  a  stochastic  driver  that  are 
difficult  to  model  with  a  deterministic  one.  As  indicated  by  Definition  1, 
random  events  are  continually  introduced  into  the  course  of  natural 
interaction,  affecting  its  outcome.  Filters  with  stochastic  drivers  can 
model  and  track  interaction  in  the  presence  of  such  noise.  In  addition, 
stochastic  drivers  are  useful  for  modeling  selection  and  choice  behavior. 
As  indicated  by  Definition  1,  goal-oriented  behavior  is  an  integral  part 
of  social  interaction.  Goals  imply  selection  and  choice.  The  range  of 
possibilities  from  filtered  output  is  narrower  than  that  of  the 


stochastic  input.  Filters  are  selective  by  definition.  A  driver  of 
white  or  colored  noise  can  represent  a  "menu."  Selections  from  the 
"menu"  can  be  inferred  from  filtered  output.  By  contrast,  choice 
behavior  is  difficult  to  model  with  a  totally  deterministic  model. 
Stochastic  input  is  required  in  a  stochastic  model  as  in  Section  1.2.1., 
but  stochastic  input  does  not  preclude  the  addition  of  deterministic 
input  to  the  system.  In  fact,  much  of  modern  controls  theory  involves 
calculation  of  deterministic  inputs  necessary  to  produce  specified 
transformational  changes  in  a  stochastic  system  (Chow,  1981). 

In  spite  of  the  possibilities  for  testing  theory,  most  time-series 
models  and  engineering  applications  delete  theory  Instantiation  as  a 
scientific  criterion  or  goal.  When  this  occurs,  the  model  becomes  a 
"black  box"  representation  (see  Makridakis  &  Wheelwright,  1979).  Black 
box  models  are  applied  in  practical  situations  where  the  goal  is  to 
predict  accurately  without  concern  for  testing  theory.  ARMA  models, 
"state-space"  representations,  and  canonical  parameter  representations 
are  generally  black  box  models  (see  Akaike,  1976;  Box  &  Jenkins,  1976; 
El-Sherief  &  Sinha,  1982).  The  objective  is  to  provide  the  best  fore¬ 
casts  possible  with  a  minimum  number  of  parameters. 

1.2.3.  Measurement  model.  In  order  to  bootstrap  through  levels 
of  theory,  a  measurement  model  needs  to  be  added  to  the  filter  in 
Section  1.2.1.  Measurement  models  are  designed  to  reduce  measurement 
error,  and  thus  increase  predictive  accuracy.  In  addition,  they 
increase  parsimony  by  reducing  the  number  of  variables  in  the  system. 


Measure  theory  in  psychology  has  traditionally  been  a  latent  variable,  or 
"hypothetical  construct"  model  (APA  et  al. ,  1954),  that  has  been  instantiated 
using  factor  analysis.  Interactivity  theory  requires  that  a  measurement  model 
be  able  to  distinguish  between  Interactive  historical  effects  and  measurement 
effects  produced  by  latent  variables.  Unfortunately,  traditional  synchronous- 
time  measurement  models,  Including  factor  analysis,  are  unable  to  make  this 
distinction  by  themselves.  Time  must  be  added  to  these  measurement  models  in 
order  to  validate  that  a  true  latent  variable  model  exists,  or  is  at  least 
possible.  Without  validating  that  a  true  latent  variable  model  exists, 
researchers  run  the  risk  of  confusing  interaction  effects  with  measurement 
effects,  with  potentially  disastrous  results.  In  this  section  and 
subsequently  whenever  measurement  models  are  discussed,  it  is  assumed  that  the 
data  has  been  standardized.  Consequently,  we  will  be  dealing  with  correlation 
Instead  of  covariance  matrices.  To  simplify  notation,  correlation  matrices 
are  represented  by  X^X',  without  dividing  by  the  product  of  sample  size  and 
variable  standard  deviations. 

For  example,  a  synchronous  correlation  matrix  between  four  variables  is 
provided  in  Equation  13, 


1.0  .36  0  0 

.36  1.0  0  0 

0  0  1.0  .51 

0  0  .51  1.0 


(13) 


rx(0)  in  E<lu#t*on  ^  appears  to  be  a  perfectly  appropriate  candidate  for 
a  measurement  model,  so  a  common  factor  analysis  was  applied.  The 
factor  loading  matrix  is  shown  in  Equation  14.  A  principal  axes  solu¬ 


tion  with  iterations  was  used. 


.60  0 
.60  0 
0  .71 

0  .71 

From  Equations  13  and  14,  it  appears  appropriate  to  form  two  scales: 
Scale  1  Is  the  average  of  Items  1  and  2,  and  Scale  2  Is  the  average  of  3 
and  4.  Applying  the  Spearman-Brown  prediction  formula  (Winer,  1971, 
p.  286),  the  reliabilities  of  these  two  scales  are  .53  and  .68,  respec¬ 
tively.  From  the  classical  relationship  between  reliability  and  validity 

(r  „  =  ) ,  a  researcher  knows  Scales  1  and  2  can  never  correlate 

*y  yy 

higher  than  .60. 

Unfortunately,  history  has  been  excluded  from  Equation  13.  It  is 

assumed  that  in  Equation  13  is  stationary.  ^M(i)  i®  Equation  15 

represents  a  stationary  first-order  historical  process  added  to  T  . 

x(0) 

in  Equation  13, 

.3  .3  0  0 

.3  .3  0  0 

.7  -.7  .4  .4 

.7  -.7  .4  .4 

Given  the  historical  process  in  Equation  15,  the  lagged  correlations  for 
Scales  1  and  2  were  computed. 
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The  lagged  correlation  between  scales,  r, .  -  -.70,  violates  the  upper 


boundary  determined  by  reliability-validity  theory,  .70  >  .60.  Relia¬ 


bilities  are  stationary  in  this  example,  so  the  upper  boundary  applies 


to  lagged  as  well  as  synchronous  correlations. 


Assume  a  different  history  in  Equation  17  were  added  to  in 


Equation  13, 


xbd) 


According  to  measurement  theory,  the  creation  of  scales  reduces  measure¬ 


ment  error.  As  a  consequence,  correlations  between  Scales  1  and  2 


should  be  higher  than  corresponding  correlations  between  individual 


items  from  different  scales.  Given  the  historical  process  in  Equation  17, 


the  lagged  correlations  were  computed  for  Scales  1  and  2, 
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The  correlations  in  Equations  16  and  18  would  be  seriously  misinter¬ 
preted  if  a  true  measurement  model  as  depicted  in  Equations  13  and  14  were 
accepted.  A  falsely  indentified  "measurement"  model  can  cover  over 
significant  interaction  effects,  and  reduce  the  correlation  between 
scales  rather  than  increase  it  (e.g. ,  see  the  0  cross-lagged  correlations 
in  Equation  18).  The  time  lagged  relationships  in  Equations  IS  and  17 
represent  relationships  between  separate  variables  rather  than  true  latent 
variables.  Synchronous-time  measurement  theory  accepts  a  latent  variable 
by  definition.  Time  must  be  added  to  verify  the  exlstance  of  true  latent 
variables.  If  true  latent  variables  don't  exist,  then  none  of  the 
traditional  measurement  theory  follows.  Tests  for  the  existence  of  true 
latent  variables  can  be  made  using  the  time-series  factor  analysis  model 
described  next. 

The  traditional  factor  analytic  model  can  be  written  as  follows: 

*1  "  -1  +  ~*t*  Where  (19) 

Xt  is  a  £  x  1_  column  vector  of  observed  variables,  with  0  means,  measured  at 
time  2.J  B  is  a  *  L  rotrlx  of  factor  loadings;  Zt  is  a  f_  x  1  column  of 
latent,  unobserved  variables;  /mxt  is  a  £  x  1  column  of  independent  measurement 
errors,  uncorrelated  with  other  variables,  with  jO  means;  and  j>  and  are 
values  identifying  the  number  of  observed  and  latent  variables,  respectively, 
at  time  t_.  For  the  sake  of  concise  notation,  sample  size  jn  has  been  deleted 
from  X£,  Zt  and  mxt  and  these  terms  are  represented  as  column  vectors  rather 
than  matrices.  Sample  size  is  implicit  in  the  vectors.  Assuming  and  Zt  to 
be  standardized,  the  expected  structure  of  the  correlations  at  time  t^  follows 


Equation  19, 
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E(X  1)  -  BP  ,mB'  4  M,  where 

E(X  X’)  Is  the  observed  correlation  matrix;  P,rt.  is  the  correlation 
matrix  of  latent  variables  Z  Z '  at  time  t;  and  M  is  a  diagonal  variance- 

-v-t^t  - 

covariance  matrix  of  measurement  errors  m  .  Equation  20  defines  the 

*xt 

traditional  factor  analytic  problem  (Joreskog,  1970;  Mulalk,  1972). 

Time  is  added  to  the  traditional  factor  analytic  model  by  assuming 
the  latent  variable  to  be  the  product  of  a  stationary  historical  process 
(see  Section  2.1.1.), 
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written  in  first  order  fora  as  in  Equation  6.  When  time  is  added  to 
the  measurement  model,  replicability  and  statlonarlty  become  issues. 
Equation  21  applies  the  simplest  assumption  of  first  order  statlonarlty. 

By  substituting from  Equation  21— at  time  t  only— into  Equation  19, 
the  model  becomes: 
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The  subscript  £_  denotes  the  order  of  the  latent  variable  process,  or 
number  of  latent  lags,  which  is  assumed  to  be  equal  to  the  number  of 
lags  In  observed  variables.  When£_*l,  the  model  does  not  continue 
beyond  jA(l).  In  Equation  22,  measurement  error  (njxt)  is  different  from 
the  error  that  drives  the  filter  (j§zt),  in  the  sense  that  measurement 
error  does  not  drive  filter  coefficients.  It  only  occurs  in  synchronous 
time  without  history  ever  being  added  to  it. 

The  overall  model  in  Equation  22  can  be  considered  nonlinear. 

There  are  a  variety  of  approaches  to  estimating  the  parameters  in  such  a 
model.  An  analytic  solution  was  selected  here  for  the  sake  of  simplicity. 

The  solution,  while  not  necessarily  optimal,  is  sufficiently  accurate  to 
illustrate  the  influence  of  time  on  the  traditional  factor  analytic 
model.  Observing  Equation  20  it  is  clear  that  and  M.  can  be  estimated 
using  traditional  factor  analytic  techniques,  £(pXp)  “  I  “  diag  £2,  where  £2 
represents  the  communallty  and  diag  places  the  communalities  as  diagonal 
entries  in  a  matrix.  This  leaves  and  the  latent  correlation 

structure  to  be  estimated. 

Time  is  added  to  the  observed  variables  through  backsubstitutlon: 


h  m  lit  +  5xt» 

—  ■  ■■ 

it-l  "  *  Zxt-v 


Next,  we  solve  Equation  23  for  Z.....Z,,  »,  by  letting  B+  -  (B'B)~*B',  the 
Moore-Penrose  generalised  inverse  of  B  (see  Green,  1976,  Appendix  B): 


(24) 


2  -  B+X  -  B+a  , 
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The  expected  latent  correlation  structure  can  be  estimated  from  Equation  24, 


5  2t^>  -1(0) 

e  (z;z  j-  p,  . 


B+(X  X'  -  M)B+' 

rfw  <*>t*t  m  *» 

B+(x„x;  jb*' 
B+(x*x;  #)b*\ 
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It  should  be  noted  here  that  when  B  is  estimated  using  a  factoring 
technique  in  which  latent  variables  are  orthogonal,  (e.g..  Principal- 
axes  method,  Mulaik,  1972)  P^  will  be  in  identity  matrix. 

The  latent  correlation  structure  is  packed  in  first  order  form  in  the 
same  way  that  and  T^  was  packed  in  Section  1.2.1.: 
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In  Equation  26,  the  lag  k  from  P,.  .  is  Ik 

—  *■*(*)  '-row 
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r  «nd  T  ...  are  limited  to  the  upper  left  block,  P/A.  and  P... 
*.(0)  £(*7  *«(0)  *w(l) 

respectively.  It  is  now  possible  to  solve  for  A  and  V  as  in 

ml  ml 

Sec  t ion  1.2.1.: 


(26) 


These  equations  represent  a  "time-series"  factor  analytic  model,  that 
was  applied  to  data  in  the  Example  Section. 


1.2. A.  Interaction  between  groups.  The  definition  of  the  human 
environment  in  Definition  1  refers  to  interaction  between  groups  as  well 
as  individuals.  When  theory  does  refer  to  interacting  groups,  the 
interacting  groups  become  the  unit  of  analysis  that  must  be  used  by  the 
methodology  to  instantiate  theory.  Generally,  Interacting  groups  are 
found  within  a  larger  social  organization.  The  structure  of  this  larger 
social  organization  must  be  taken  into  account  by  methodology.  In 
order  to  correctly  instantiate  theory  involving  group  interaction,  then, 
appropriate  groups  as  opposed  to  individuals  must  be  designated  as  the 
units  of  analysis,  and  the  structure  of  these  groups  in  the  larger 
social  organization  must  be  taken  into  account.  Research  results  are 
sensitive  to  these  requirements. 

The  reasons  for  the  conclusions  are  illustrated  by  example.  When 
groups  are  the  unit  of  analysis,  group  aggregated  means  provide  scores 
to  be  used  in  an  analysis.  Generalization  theory  can  be  used  to  clarify 
the  structure  of  these  group  aggregated  scores.  Generalization  theory 
applies  analysis  of  variance  to  complex  data  structures  in  order  to 
estimate  variance  components,  and  generalized  analogies  of  reliability 
and  correlation  coefficients  (see  Shavelson  &  Webb,  1981).  A  model 


statement  Is  provided  for  the  U.  S.  Army  data  in  the  Example  Section. 

The  structure  of  this  survey  data  at  time  £  is  described  by: 

Y  *  p  +  A  +  B(A)  +  C(AB)  +  R  +  AR  +  BR(A)  +  CR(AB)  +  S(ABCR)  +  <} 

+  A£  +  B£(A)  +  C£(AB)  +  R£  +  AR£  +  BR^(A)  +  CRQ(AB)  +  SQ(ABCR) . 

Nesting  relationships  are  indicated  by  parentheses.  Potential  units  of 
analysis  are  defined  by  nested  levels  of  hierarchy;  A,  B<(A) ,  C(AB) , 
and  S(ABCR) ;  defined  as  brigade,  battalion,  company,  and  subject, 
in  this  example.  R  refers  to  subgroups  that  cross  levels  of  hierarchy 
above  subjects;  in  this  example,  rank  and  race,  among  others.  refers 
to  questionnaire  items.  From  the  complexity  of  Equation  28,  it  becomes 
clear  that  there  is  an  Increase  in  the  number  of  ways  correlations/ 
covariances  can  be  computed  using  group  as  opposed  to  individual  level 
data.  A  rich  variety  of  hypotheses  can  be  tested  with  group  level  data 
For  example.  Interaction  between  subgroups  within  companies  (e.g., 
superiors  and  subordinates,  blacks  and  whites)  is  possible  with  such 
data. 

Associated  with  each  term  that  can  serve  as  a  unit  of  analysis.  A, 

2  2  2  2 

JJ,  £  and  j>,  is  a  variance  component,  *  °g  *  °c  *  an<*  °s  *  These 
variance  components  are  the  ones  of  interest  in  the  analysis,  even 
though  the  expected  mean  squares  for  MS^,  MS^,  MS^.,  and  MS^  contain 
additional  variance  components,  depending  upon  the  sampling  plan  in  the 
design  (see  Hart  &  Bradshaw,  Note  2).  In  reliability  or  correlational 


analyses,  variance  components  are  assigned  the  status  of  either  "true' 


2 

or  "error"  variance.  Ultimately,  the  status  of  "true"  variance  (°true) 

2  2  2  2 

is  assigned  to  »  °g  *  °q  or  °s  by  theory.  Theory  pinpoints  the 
unit  of  analysis  term  from  among  MS^,  MS^ ,  KS^,  and  MS,. .  The  expectation 

_  _  _  _  2 

of  this  term  E(MS)  must  contain  the  true  variance  component  °true"  For 

2 

reasons  to  be  discussed,  "error"  variance  (o  )  status  is  assigned 

error 

2  2  2  2 

all  the  other  components  ( a ,  o„  ,  ar  ,  or  ae  )  besides  the  one  selected 

A  D  L  b 

o 

as  the  unit  of  analysis  (°true)*  With  these  assignments,  the  status  of 

~2  2  2  2 

the  variance  components  (o^  ,  ,  o^,  ,  os  )  changes  as  the  corresponding 

unit  of  analysis  (A,  1^,  £,  or  £)  changes.  What  is  "true"  variance  at 


one  level  becomes  "error"  at  the  next.  For  example,  if  subjects  represent 
the  unit  of  analysis,  0^  =  o$2  and  -  0*,  and  oc2.  M§total 


contains  both  true  plus  error  variance,  MS^  .  “  MSg- 

2  _ 

represent  the  unit  of  analysis,  Mstotal  *  MSC>  otrue  * 


If  companies 


and  a 


2 

error 


',  and  0g 
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The  status  of  o^,  and  0g  changed  as  the  unit  changed. 


Variance  components  can  be  divided  into  two  classes  by  ordering 

2  2  2  2 

them  hierarchically,  o^  »  °g  »  ’  an<*  separating  the  components 

above  the  designated  unit  of  analysis  from  those  below.  The  reason  for 
assigning  "error"  status  to  these  two  classes  differs.  Correlational 
analyses  like  the  one  in  Section  1.2.1.  require  independent  observations 
on  units  of  analysis.  Components  in  the  upper  class  are  designated  as 
error  because  they  represent  dependence  between  observations  that  are 
supposed  to  be  independent.  For  example,  if  subjects  represent  the  unit 
of  analysis,  the  o  ,  o  ,  o_  components  represent  "improper"  dependencies 


between  individual  level  observations,  analogous  to  "autoregression" 

errors  in  a  time-series  design  (Hibbs,  1974).  These  dependencies  need 

to  be  filtered  out  prior  to  entering  the  observations  into  correlational 

analyses.  Components  beneath  the  unit  of  analysis  term  are  designed  as 

error  when  they  are  sampled.  For  example,  in  the  Example  Section, 

companies  are  designated  as  the  unit  of  analysis.  Individual  soldiers 

within  companies  were  sampled  in  order  to  estimate  company  means.  By 

2 

sampling  subjects,  <jg  becomes  a  component  of  "sampling  error"  that 
shows  up  in  the  expected  mean  square  term  for  companies  E(MSp) . 

The  results  of  correlational  analyses  are  determined  by  the 
relative  size  of  "true"  and  "error"  variance  components.  Total  variance 
is  a  sum  of  true  plus  total  error  variance.  Generalization  theory 
defines  correlation  and  reliability  coefficients  (positive  sign)  in 
terms  of  a  ratio  of  true  to  total  variance  (see  Kane  &  Brennan,  1977; 
Winer,  1971,  pp.  283-296;  Hart  &  Bradshaw,  Note  2).  Estimates  for 
correlations  and  reliabilities  are  obtained  by  solving  for  this  ratio 
definition  using  appropriate  mean  square  terms.  In  this  context, 
correlations  can  be  estimated  from  a  generalization  of  the  intraclass 
correlation  coefficient: 


[MS,  ,  -  MS  ]/ [MS  ,  +  (n-l)MS  ]. 
— total  — error  — total  —  — error 1 


Likewise,  reliability  coefficients  for  mean  scores  can  be  estimated  by: 


(MS.  .  -  MS  ) /MS 
— total  — error  — total 


V 
on » 


It  is  evident  froa  Equations  29  and  30  that  correlations  and  reliabil- 

2  2 

ltles  are  large  when  a  ,  MS  ,  are  large,  and  o  ,  MS  are 

B  true  — total  6  error*  — error 

small.  Furthermore,  the  results  will  be  sensitive  to  selection  of  the 
unit  of  analysis.  The  terms  that  can  be  substituted  into  these  formulas 
vary  as  the  unit  of  analysis  changes.  The  term  designated  as  the  unit 
of  analysis  is  always  MS^  M^rror  *s  a  "sampling  error"  term  that 

also  varies  with  the  unit  of  analysis.  This  term  must  either  (a)  belong 
to  the  nested  hierarchy  below  the  unit  of  analysis  term,  or  (b)  represent 
an  interaction  between  the  unit  of  analysis  and  the  variable  being 
correlated  (see  Hart  &  Bradshaw,  Note  2).  The  value  n  represents  the 
number  of  observations  sampled  (e.g.,  questionnaire  items,  subjects 
within  companies).  The  use  of  Equations  29  and  30  is  illustrated  by 
comparing  the  following  substitutions:  for  individuals,  MS^^^  *  MS^ , 


true 


2  2  2 
o„  ,  MS  ■  MS„„,  o  *  o0_  ,  n  *  number  of  questionnaire 

£  — grror  — -SC£  error  SQ  —  n 


items;  for  companies,  MStotal  *  MS^,  atrug 


°r  ,  MS 


:rror 


MS_,  o 


error 


*  Og  »  n  m  number  of  subjects  within  companies.  The  first  set  of  sub¬ 
stitutions  represent  correlations  between  items  for  individuals,  while 
the  second  set,  correlations  between  subjects  within  companies  at  the 
company  level.  In  this  example,  true  variance  in  MS,.  at  the  individual 
level,  became  error  variance  at  the  company  level. 

Given  that  correlations  are  a  function  of  the  sizes  of  "true"  and 
"error"  variance  components,  and  that  true  and  error  designations  change 
as  the  unit  of  analysis  changes,  then  it  follows  that  conclusions  reached 
at  one  level  may  be  quite  different  than  conclusions  reached  at  another. 
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These  results  demonstrate  why  individual  level  data  cannot  be  used  to 
instantiate  theory  about  group  interaction,  and  why  group  data  from  one 
level  of  hierarchy  cannot  be  used  to  instantiate  theory  about  another 
level,  without  violating  the  principle  of  empiricism.  Unfortunately, 
it  is  common  to  see  group  level  theory  "tested"  using  individual  level 
data,  or  using  an  inconsistent  mix  of  group  and  individual  level  data 
(see  Bowers,  1973;  Passmore,  1976;  Taylor  &  Bowers,  1972,  p.  54; 

Torbert,  1973). 

1.3.  Comparison 

In  order  to  clarify  the  nature  of  interactivity  theory,  it  is 
instructive  to  contrast  it  with  other  commonly  used  methodologies;  in 
this  case  with  analysis  of  variance.  Comparisons  are  made  using 
relevant  scientific  criteria  as  guidelines,  i.e.,  empiricism,  predic¬ 
tion,  replication  and  parsimony.  In  this  case,  theory  Instantiation 
provides  the  basis  for  comparison. 

Analysis  of  variance,  by  itself,  does  not  do  a  good  job  of 
instantiating  an  interactive  theory  of  the  environment,  defined  gener- 
ically  in  Definition  1.  Design  requirements  in  experiments  are  dictated 
by  the  method  of  analysis,  in  this  case  analysis  of  variance.  The  use 
of  analysis  of  variance  on  randomized  experiments  is  justified  by  the 
Gaus-Markov  theorem  (Bock,  1975,  pp.  175,  235-236).  In  order  to  create 
a  system  that  approximates  a  Markov  process,  history  must  be  removed  by 
the  random  assignment  of  units  (people  or  groups)  to  treatment  con¬ 
ditions.  In  addition,  analysis  of  variance  assumes  treatment  conditions 
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affect  only  means,  not  variance-covariance  structures.  Since  history 
affects  variance-covariance  structures  (Chow,  1975),  history  must  be 
removed  by  random  assignment.  With  past  history  removed  from  a  given 
situation,  subjects  may  often  have  a  short-term  view  of  the  future.  In 
fact  most  experiments  examine  single  one-step  responses  of  subjects  to 
treatment  conditions.  One-step  responses  are  consistent  with  a  Markov 
process.  In  addition  to  removing  history,  treatment  conditions  are 
deterministic,  which  means  that  all  subjects  within  the  same  treatment 
condition  must  receive  exactly  the  same  predetermined  treatment. 
Causation  is  unidirectional,  from  independent  to  dependent  variables. 

These  analysis  of  variance  design  requirements  create  difficulties 
for  Instantiating  an  interactive  theory  of  the  human  environment.  For 
example,  interaction  as  defined  in  Definition  1  requires  time,  with  past 
history  and  future  goals.  This  is  difficult  to  achieve  in  most  ANOVA 
designs,  since  history  and  variance-covariance  effects  must  be  removed 
through  random  assignments  to  new  situations.  By  definition,  inter¬ 
action  involves  exchange.  The  forms  of  exchange  in  most  ANOVA  designs 
are  highly  restricted,  limited  to  one-way,  treatment-to-dependent- 
varlable  exchanges;  in  which  the  treatment  party  must  remain  nonrespon- 
sive  to  whatever  the  subject  does,  since  treatment  effects  have  to 
remain  deterministic.  Given  such  "unnatural"  restrictions,  it  Is  not 
surprising  that  criticisms  have  been  leveled  at  experimentalism.  The 
meaning  and  interpretation  of  treatment  effects,  and  the  "external 
validity"  of  dependent  variable  responses,  becomes  a  problem  when  time 


(past  and  future)  In  the  experimental  setting  is  artificially  truncated 
(see  Alexander  4  Knight,  1971;  Bern  &  Funder,  1978).  "Spurious"  forms  of 
interaction,  e.g.,  "social  desirability"  responses  and  demand  character¬ 
istics,  (Brehm,  1966;  Orne,  1962;  Rosenthal  &  Rosnow,  1969)  may  pop  up 
in  many  experimental  situations  precisely  because  normal  forms  of  inter¬ 
action  are  so  severely  restricted.  Human  experiments  are  often  designed 
like  agricultural  experiments.  Analysis  of  variance  has  had  a  long  and 
productive  history  in  agricultural  experimentation  (see  Cochran  &  Cox, 
1957),  but  it  should  be  recognized  that  human  environments  are  often 
interactive  in  ways  that  plant  environments  are  not. 

These  comparisons  should  not  be  interpreted  as  criticism  of  the 
experimental  paradigm  per  se,  but  as  a  criticism  of  how  analysis  of 
variance  has  been  uncritically  applied  to  basically  interactive  problems, 
when  other  more  appropriate  forms  of  design  and  analysis  are  possible. 
Experiments  can  be  designed  in  ways  that  take  advantage  of  the  inter¬ 
pretive  benefits  of  random  assignment  while  still  accurately  instantiating 
interactive  situations.  Linear  prediction  filters  can  be  adapted  for 
the  analysis  of  interactive  experiments.  History  could  be  reintroduced 
after  random  assignment,  by  allowing  relatively  free  forms  of  inter¬ 
action  between  participants  in  the  situation.  Deterministic  input  in 
the  creation  of  treatment  conditions,  could  be  handled  using  one  of  two 
distinctly  different  formats:  using  open-  or  closed-loop  filters.  With 
open-loop  filters,  deterministic  input  is  not  contingent  upon  subjects' 
responses,  as  it  is  not  in  traditional  experimental  designs.  With 


"closed-loop"  filters,  input  is  contingent  upon  subjects'  responses,  as 
it  is  in  operant  conditioning.  Open-loop  input  changes  variance- 
covariance  structures  (Chow,  1975,  pp.  150-152).  The  object  of  the 
design,  using  an  open-loop  format,  would  be  to  examine  the  effects  of 
treatment  conditions  on  covariance  structures,  as  they  reflect  different 
patterns  of  change  during  interaction.  By  contrast,  the  object  of  the 
design  using  closed-loop  filters  could  be  to  examine  transformational 
changes  in  response  to  contingent  input,  to  see  if  preestablished  goals 
can  be  achieved  in  this  way.  Controls  theory  problems  in  engineering 
and  economics  are  often  described  in  this  way  (Chow,  1981;  Elgerd,  1967). 
It  should  be  possible  to  design  closed-loop  filters  so  that  changes  in 
means  can  be  examined  while  changes  in  variance-covariance  structures 
are  controlled.  The  use  of  filters  in  the  analysis  of  experimental  data 
is  an  open  area  that  requires  further  research. 

2.  Replication 

Time  is  an  inherent  attribute  of  any  interactive  environment.  The 
ability  to  replicate  involves  the  ability  to  repeat  observed  relation¬ 
ships  at  new  times.  Relationships  must  be  time- invariant  for  replica¬ 
tion  to  occur.  Parameters  that  are  used  to  describe  relationships  are 
unreplicable  if  "population"  parameters  wander  in  some  unknown  way  as  a 
function  of  time.  When  they  do,  repeated  samplings  will  produce 
different  results.  Patterns  in  relationships  will  be  unreplicable.  In 
order  to  replicate,  then,  complex  relationships  must  be  reduced  to  a 


time- invariant  representation.  This  becomes  more  difficult  as  interaction 


becomes  more  adaptive,  since  adaptivity  frequently  implies  time-variability. 
The  simplest  case  with  little  adaption  is  discussed  first,  followed  by 
more  difficult  adaptive  concepts. 

2.1.  Without  Adaption 

2.1.1.  Stationarity.  Time- invariant  representations  of  relation¬ 
ships  exist  at  different  levels  of  complexity  depending  on  the  degree  of 
adaptivity  in  the  relationship:  with  low  adaptivity,  the  simplest  level 
of  time- invariance  for  linear  prediction  filters  is  applicable.  Time- 
invariance  at  this  level  is  labeled  covariance  stationarity  (see  Granger 
&  Newbold,  1977,  pp.  3-5).  The  means  and  variance  of  variables  following 
covariance  stationary  processes  do  not  change  through  time.  The  covari¬ 
ances  between  variables  remain  constant  at  given  distances  or  lags, 
producing  a  pattern  of  equalities  in  a  covariance  matrix.  In  addition, 
the  linear  parameters  that  generate  a  stationary  covariance  matrix  are 
considered  time- invariant  too. 

The  model  in  Section  1.2.1.  is  based  on  the  assumption  of  covari¬ 
ance  stationarity.  A  stationary  covariance  matrix  is  one  that  follows  a 
block  Toeplitz  pattern.  A  Toeplitz  matrix  has  the  property  that  all 
entries  along  diagonals— parallel  to  the  principle  diagonal — are  the 
same.  A  block  Toeplitz  matrix  is  one  that  is  partitioned  into  blocks 
with  block  entries  down  the  diagonals.  The  corresponding  elements 
within  blocks  are  the  same  down  the  diagonals.  In  Section  1.2.1.,  the 
covariance  matrix  remains  constant  at  a  given  lag,  e.g.,  at  lag  k  *  1, 

XX'  “X  .X'  ry  This  pattern  of  equalities  produces  a  block  Toeplitz 
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matrix,  i.e.,  repeats  itself  down  the  principle  diagonal.  With 

this  repetition,  appears  twice  in  Equation  ll.  The  parameters  in  A 

and  m  generate  this  stationary  covariance  structure.  Entries  within  the 
A  and  V*  matrices  can  differ  but  each  entry  is  invariant  as  the  system 
iterates  through  time,  t_  *  1,  2...®.  The  concept  of  a  stationary  repre¬ 
sentation  is  one  factor  that  separates  time-series  models  from  structural 
equation  models  commonly  used  in  psychology  (Joreskog  &  Sorbom,  1979) . 

2.1.2.  Preemptive  prioritization.  Although  first-order  time 
invariance  requires  stationary  (block  Toeplitz)  covariance  matrices, 
sample  covariance  matrices  frequently  are  not  stationary  exactly.  In  a 
panel  design,  for  example,  separate  estimates  are  available  for  each 
element  in  a  covariance  matrix.  In  a  stochastic  system,  sample  covari¬ 
ances  will  differ  from  expected  values  in  finite  samples.  For  these 
reasons,  sample  covariances  will  not  be  exactly  stationary  in  a  panel 
design,  even  when  the  underlying  data  follow  a  model  in  which  expected 
values  of  covariances  are  exactly  stationary.  In  a  time-series  design, 
sample  covariances  may  or  may  not  have  stationary  block  Toeplitz  struc¬ 
ture  depending  on  the  sampling  window  used  to  compute  the  sample  covari¬ 
ance  matrix.  It  is  clear  that  there  are  four  possible  sampling  windows 
that  can  be  used  to  compute  sample  covariances  (see  Friedlander,  1982a, 
p.  838;  Kay  &  Marple,  1981,  p.  1391). 


In  Equation  31  l  is  defined  as  in  Equation  6.  Only  the  autocorrelation 
window  produces  exactly  stationary  block  Toeplitz  matrices.  This  is 
true  because  covariance  estimates  that  share  a  common  lag  Jc,  are  computed 
across  data  elements  that  are  all  identical  in  this  instance.  The  data 
elements  are  not  all  identical  for  the  other  windows;  consequently,  the 
matrices  will  not  be  exactly  Toeplitz,  although  they  will  generally  be 
close  to  Toeplitz  form. 

A  chi-square  test  is  available  to  see  if  deviation  from  stationarity 
block  Toeplitz  form  is  statistically  significant  (see  Browne,  1977;  Burg, 
Luenberger  &  Wenger,  1982;  Joreskog  &  Sorbom,  1979;  Steiger,  1980).  Tests 
can  be  computed  directly  on  sample  covariance  matrices  from  panel  designs. 
In  time-series  designs,  more  than  one  sample  from  sequential  windows  of 
the  time-series  is  needed. 

Two  mutually  incompatible  goals  arise  when  covariance  matrices  are 
not  exactly  stationary.  Stationarity  requires  a  block  Toeplitz  structure, 
e.g.,  duplication  of  along  the  principle  diagonal  in  Section  1.2.1. 

On  the  other  hand,  estimating  linear  parameters,  e.g.,^A,  requires 
optimizing  an  achievement  function,  e.g.,  minimizing  the  trace  of  V. 

For  a  stationary  covariance  matrix,  the  achievement  function  is 
written  as  a  function  of  T^^(see  Equation  11).  In  an  unstationary 
representation,  two  different  matrices  appear  in  Equation  11  in  the 
place  of  .  The  goal  of  providing  a  stationary  representation  of  an 

unstationary  covariance  matrix  conflicts  with  the  goal  of  minimizing  the 
achievement  function  V,  which  becomes  apparent  from  the  conflicting  ways 


r(Q)  must  be  handled  to  achieve  each  goal. 

The  concept  of  preemptive  prioritization  Is  borrowed  from  goal 


programming  (Ignizio,  1976,  1982)  to  handle  these  conflicting  goals. 

One  goal  is  satisfied  ahead  of  the  other.  The  achievement  function  is 
an  ordered  variable  that  is  lexicographically  minimized  (see  Ignizio, 
1982,  chap.  17).  Statlonarity  is  given  preemptive  priority  due  to  the 
centrality  of  the  replication  concept.  A  stationary  block  Toeplltz 
structure  is  imposed  first  on  the  sample  covariance  matrix  using  least 
squares  or  maximum  likelihood  estimators,  and  then  linear  parameters 
(e.g..  A)  are  estimated  next  based  on  the  imposed,  stationary  structure 
(see  Burg  et  al.,  1982).  The  objective  of  this  procedure  is  to  find  the 
"best"  time- invariant  estimators.  The  estimators  are  time- invariant  in 
a  first-order  sense.  If  the  sample  covariance  matrix  deviates  signifi¬ 
cantly  from  stationary  block  Toeplitz  structure,  then  the  underlying 
process  can  no  longer  be  considered  time- invariant  in  a  first  order 
sense  and  more  complex  adaptive  models  are  needed.  The  necessity  for 
time- invariant  representations  becomes  clear  from  a  discussion  of  the 
consequences  of  Ignoring  them  (see  Section  2.3.). 

2.2.  Adaption 

Interaction  as  defined  by  Definition  1  requires  adaption.  The 
attempt  to  model  adaptive  processes  with  linear  parameters  may  produce 
estimates  that  are  time-variable.  The  concept  of  higher-order  time 
invariance  is  required  to  reduce  representations  to  time- invariance. 

The  concept  of  higher  order  t ime- invar lance  involves  representing  an 


adaptive  process  in  terms  of  a  more  complex  model  statement.  In  the 
model  statement,  parameters  are  written  as  products  or  sums  of  stationary 
and  unstationary  processes.  For  example,  if  the  parameters  A  from 
Equation  6  were  time-variable,  then  the  ways  in  which  the  A  parameters 
adapt  can  be  modeled  by  treating  A  like  "data"  in  an  equation  of  the 
following  form: 


A  =  GA  .  +  e  , 

fm  t  ***  t-1  **At 


Where  G  represents  a  matrix  of  stationary  time- invariant  linear  param¬ 
eters,  A^  represents  a  matrix  of  unstationary  time-variable  parameters, 
and  e  represents  white  noise,  uncorrelated  with  A  or  X  .  Substituting 
A  in  Equation  32  for  A  in  Equation  6  produces  a  model  statement  for  X 
that  is  stationary  or  time- invariant  in  a  second-order  sense: 


X„  *  GA  .X,.  .  +  v  . 
out  -1  ~t 


While  the  A  parameters  change  as  function  of  time,  the  way  in  which  they 
change  is  modeled  by  the  time- invariant  G*  matrix.  If  the  way  parameters 
adapt  can  be  modeled,  then  time- invar lance  occurs  at  a  higher  level  and 
replication  of  the  processes  is  possible. 

A  wide  variety  of  models  are  possible  that  are  stationary  in  a 
higher  order  sense.  Models  analogous  to  Equation  33  have  been  applied 
to  physical,  biological,  and  economic  systems  (see  Kalman  Filtering, 


Chow,  1981,  chap.  6;  Kashyap  &  Rao,  1976).  In  psychology,  Kenny  (1973, 
1975b)  introduced  the  concept  of  quasi-stationarity :  Correlation 
matrices  are  permitted  to  be  nonstationary  so  long  as  they  become 
stationary  after  adjusting  for  measurement  error.  Extending  this  con¬ 
cept,  measurement  parameters  can  be  allowed  to  vary  as  a  function  of 
time,  while  nonmeasurement  "latent"  parameters  remain  stationary.  The 
measurement  model  in  Section  1.2.3.  can  readily  be  adapted  in  this  way. 
Models  are  possible  in  which  stationary  processes  are  analyzed  after 
unstationary  components  are  removed.  Some  adaptive  models  may  simply 
track  adaptive  changes  in  linear  parameters  without  modeling  the  form 
that  this  change  takes  (see  Friedlander,  1982a;  Kay  &  Marple,  1981)  . 

Even  in  this  case,  a  stationary  representation  is  imposed  over  a  short 
sampling  interval,  and  changes  in  stationary  representations  are  tracked. 
It  should  be  noted  that  reasonably  large  data  bases  may  be  required  to 
support  adaptive  models.  The  number  of  parameters  required  to  model 
adaptive  systems  will  often  increase  over  nonadaptive  systems,  requiring 
more  data  to  estimate  parameters.  An  extensive  literature  on  adaptive 
systems  exists  in  the  electronics  engineering  literature  (see  Chow,  1981; 
Friedlander,  1982a).  However,  this  discussion  is  limited  to  introducing 
the  concepts  of  adaption  and  higher  order  time- invariance  just  discussed. 
2.3.  Comparison 

Replication  is  a  frequent  problem  in  psychological  research. 


particularly  for  interactive  environments  (see  Epstein,  1980;  Greenwald, 
1975,  1976a).  This  problem  is  often  due  to  parameters  wandering  in 


unknown  ways  as  a  function  of  time.  When  this  occurs  it  becomes 
impossible  to  replicate  results,  no  matter  how  random  the  samples  taken 
or  how  "normal"  the  population  distribution.  The  problem  is  not  that 
the  parameters  wander,  but  thay  they  wander  in  unknown  ways.  Change  in 
wandering  parameters  can  be  accounted  for  by  another  stationary  set  that 
determines  how  the  wandering  occurs,  producing  time- invar ance  at  a 
higher  level.  At  a  minimum,  replication  of  results  requires  paying 
attention  to  the  time-invariance  issue.  With  the  exception  of  cross- 
lagged  correlation  (Kenny,  1973,  1975b)  and  single  case  time-series 
designs,  this  issue  has  been  largely  ignored  in  psychology.  Under  these 
circumstances  it  is  not  surprising  that  replication  has  been  difficult. 

The  issue  of  time  invariance  applies  to  transformational  as  well  as 
historical  change.  For  example,  the  issue  applies  to  quasi-experimental 
studies  designed  to  evaluate  the  effects  of  social  intervention. 
Unstatlonary  change  in  means  or  covariance  are  expected  as  a  consequence 
of  the  intervention  (see  Kenny,  1975a).  However,  these  changes  are  only 
unstationary  in  a  first  order  sense.  The  intervention  and  only  the 
intervention  is  supposed  to  account  for  this  unstatlonary  change.  This 
means  the  same  form  of  unstatlonary  change  is  expected  every  time  the 
intervention  occurs  and  only  when  it  occurs.  As  a  consequence,  expected 
change  is  stationary  or  time-invariant  in  a  second  order  sense.  Quasi- 
experimental  intervention  designs  should  be  able  to  demonstrate  this 
sort  of  second  order  time  invariance.  This  could  be  accomplished  by 
showing  experimental  groups  undergo  unstatlonary  change  of  specified  form 


after  an  intervention,  but  not  before;  while  change  in  a  control  group 
remains  stationary.  Again,  this  issue  has  not  received  direct  attention 
in  this  context  (see  Cambell  &  Stanley,  1966;  Simonton,  1977). 

3.  Prediction 

Forecasts  about  the  future  based  on  past  hisotry  can  be  made  for 
individual  cases  using  linear  prediction  filters.  These  forecasts  are 
made  one  step  at  a  time  (see  Chow,  1975;  Gilchrist,  1976;  Granger  & 
Newbold,  1977).  The  concept  of  prediction  and  replication  overlaps  in 
many  ways.  Prediction  requires  that  linear  coefficients  (e.g.,  A) 
replicate  themselves  from  one  step  to  the  next,  i.e.,  require  a  stationary 
representation.  Replication  itself  is  a  prediction  about  past  structure 
replicating  Itself  in  new  samples. 

3.1.  Prediction  of  Nonlinear  Change 

In  Section  1.2.1.,  information  useful  for  prediction  is  contained 
in  A.  The  A  matrix  is  composed  of  linear  coefficients.  This  means  that 
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forecasts  between  adjacent  sampling  intervals  must  be  linear.  However, 
the  definition  of  the  environment  in  Definition  1  requires  that  nonlinear 
change  be  tracked.  Change  over  long  intervals  seems  inherently  nonlinear. 
Linear  projections  over  extended  periods  will  always  blow  up  toward 
infinity  as  time  Increases,  which  does  not  reflect  the  nature  of  inter¬ 
active  phenomena. 

Linear  prediction  filters  do,  in  fact,  predict  nonlinear  change 


over  multiple  sampling  Intervals.  When  forecasts  are  made  using  A, 
sequential  one-step  forecasts  are  made  into  the  future,  deleting  unknown 


future  error  terms  (e.g.,  v  in  Equation  6).  Since  the  coefficients  in 

— t 

A  do  not  change  as  a  function  of  time  (see  Section  2.1.1.),  the  equation 

m 

becomes  a  homogeneous  linear  difference  equation  with  constant  coeffi¬ 
cients  (see  Chow,  1975,  chap.  2;  Dahlquist  &  Bjorck,  1974,  pp.  368-370). 

A  polynomial  equation  (labeled  the  "characteristic"  polynomial)  describes 
the  form  of  nonlinear  chance  projected  by  homongeneous  linear  difference 
equations.  It  is  possible  to  vary  the  parameters  of  this  polynomial  to 
describe  many  forms  of  nonlinear  change.  Tr.a  parameters  of  the  character¬ 
istic  polynomial  are  derived  from  the  eigenvalues  (roots)  and  eigenvectors 
of  A.  When  a  pair  of  roots  is  complex  conjugate,  the  form  of  change 
described  by  these  roots  is  a  cosine  wave.  Positive  real  roots,  less 
than  one,  produce  nonoscillating  exponential  decay.  The  form  of  change 
is  explosive  and  grows  as  a  function  of  time,  if  the  absolute  value  of 
the  roots  is  greater  than  one,  and  is  dampened  and  decays  to  zero  if  the 
absolute  value  is  less  than  one.  Negative  real  roots  produce  rapid  oscil¬ 
lation.  When  different  types  of  roots  (i.e.,  positive  real,  negative  real, 
complex  conjugate)  appear  in  the  same  stationary  system,  the  final  form  of 
change  is  a  composite  defined  by  the  sum  of  dampened  cosine  waves,  and 
decaying  exponentials.  The  relative  contributions  of  each  component  to  the 
final  form  of  change  is  determined  by  the  size  of  the  absolute  value  of 
the  roots.  The  largest  roots  dominate  the  composite,  particularly  as 
the  system  iterates  forward  in  time  away  from  the  initial  conditions. 

It  should  be  clear  from  the  preceding  discussion  that  linear  predic¬ 
tion  filters  can  track  a  large  class  of  nonlinear  changes.  These  changes 


are  described  in  terms  of  dampened  cosine,  and  decaying  exponential 
components.  The  linear  forecast  that  occurs  at  each  step  Is  a  discrete 
linear  approximation  to  nonlinear  change.  Conditions  must  be  Imposed  on 
the  way  the  process  is  sampled  In  order  for  linear  prediction  to  adequately 
approximate  nonlinear  change.  First,  it  is  much  easier  to  identify  the 
process  if  it  is  sampled  on  an  equal  interval  basis.  If  the  process  is 
not  sampled  in  this  way,  additional  assumptions  and  methods  to  approximate 
the  equal  interval  criterion  are  possible,  in  addition, 

samples  must  be  taken  frequently  enough  to  ensure  that  the  linear  projec¬ 
tion  between  adjacent  intervals  is  an  adequate  approximation  to  the 
nonlinear  change  that  actually  occurred.  As  the  sampling  interval  is 
reduced,  resolution  of  the  form  of  nonlinear  change  that  actually 
occurred  becomes  better.  When  change  involves  oscillation,  the  size  of 
the  sampling  Interval,  At^  must  be  within  the  Nyquist  frequency  (Bloom¬ 
field,  1976,  pp.  26-27); 

2 At  s  P,  where  (3 

£  is  the  period  of  the  highest  frequency  oscillation  in  the  system.  If 
sampling  does  not  remain  within  the  Nyquist  frequency,  aliasing  occurs 
(see  Bloomfield,  1976,  pp.  204-208)  and  information  is  irretrievably 
lost.  The  most  efficient  sampling  rate  is  at  the  Nyquist  frequency, 
without  exceeding  it. 

The  covariance  and  correlation  functions  contain  information  about 


both  the  stochastic  and  deterministic  components  of  a  model.  The 
deterministic  components  are  contained  in  A.  These  components  are  used 
to  track  and  forecast  nonlinear  patterns  of  change.  Since  the  covari¬ 
ance  matrix  also  contains  deterministic  components,  nonlinear  change 
must  be  identifiable  from  the  covariance  matrix.  The  covariance  coeffi¬ 
cient  reflects  the  degree  of  linear  association  between  variables. 
However,  the  degree  of  linear  association  varies  as  a  function  of  the 
measurement  lag  throughout  the  matrix,  producing  a  pattern  in  the 
covariance  matrix  that  identifies  the  type  of  nonlinear  change  that 
occurred.  For  example,  when  the  roots  of  A  are  complex  conjugate,  the 
pattern  in  the  covariance  matrix  follows  a  dampened  cosine  wave  which 
oscillates  at  the  same  frequency  as  the  deterministic  forecasts  provided 
by  A.  When  the  roots  of  A  are  positive  and  real,  the  covariances 
follow  a  decaying  exponential  pattern  as  in^A  (see  Chow,  1975,  chap.  1-4; 
Granger  &  Newbold,  1977,  chap.  1-3).  However,  in  covariance  matrices, 
coefficients  vary  backward  in  time  as  a  function  of  k,  instead  of  forward 
in  time  as  a  function  of  t_,  as  do  forecasts  from  A.  The  nonlinear 
patterns  in  correlation  matrices  are  used  to  help  identify  time-series 
models  (see  Box  &  Jenkins,  1976;  McCleary  &  Hay,  1980). 

3.2.  Covariances  as  Prefilters 

There  are  two  approaches  to  the  analysis  of  time-series  data:  the 
direct  approach  via  Fast  Fourier  Transform  and  the  indirect  approach  via 
the  autocorrelation/autocovariance  function  (Kay  6,  Marple,  1981,  p.  1383) 
Linear  prediction  filters  follow  the  indirect  approach.  In  Section  1.2.1 


A  is  a  function  of  the  covariance  function  as  shown  in  Equation  9.  The 

covariance/correlation  function  serves  as  a  prefilter  of  the  data  prior 

to  estimation  of  A.  It  follows  that  other  measures  besides  covariances 
.♦*1 

and  correlations  might  be  used  in  certain  Instances  as  prefilters. 
Section  1.2.4.  suggests  the  possibility  of  using  variance  components  as 
prefilters.  These  variance  components  can  be  used  to  reflect  structure 
of  group  aggregated  scores  and  to  represent  theoretically  relevant 
aspects  of  group  interaction.  In  addition,  polychoric  correlations 
could  be  examined  as  prefilters  when  there  is  some  reason  to  suspect  the 
adequacy  of  standard  linear  approximations  between  sampling  intervals 
(see  Martinson  &  Hamden,  1975). 

3.3.  Comparison 

3.3.1.  Nonlinear  change.  Unfortunately,  the  use  of  discrete 
linear  models  to  approximate  long-term  nonlinear  change,  has  been 
Ignored  in  psychology.  This  seems  to  be  due  to  an  assumption  that 
nonlinear  information  is  unavailable;  e.g.,  "...  panel  data  used  in 
psychological  and  educational  research  are  often  limited  to  two  or  three 
waves  and  thus  a  straight  line  model  for  growth  is  as  complex  as  the 
data  can  support"  (Rogosa,  Brandt  &  Zimowski,  1982,  p.  728).  As  noted 
in  Section  3.1.  and  the  Example  Section,  linear  prediction  filters  can 
detect  a  variety  of  forms  of  nonlinear  change  from  two  or  three  waves  of 
panel  data.  Applying  the  assumption  that  nonlinear  information  is 
unavailable  to  filters  can  lead  to  serious  errors  in  selecting  sampling 
intervals.  Appropriate  sampling  intervals  are  necessary  to  enable 
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discrete  Linear  statistics  to  model  nonlinear  change.  Serious  miscon¬ 
ceptions  can  result  from  selecting  sampling  intervals  that  violate  the 
Nyquist  frequency  (Equation  34).  To  illustrate,  suppose  the  following 

A  and  V  (see  Equations  6  and  11)  were  to  generate  the  correlation  matrix 

-**  /m 

in  and  below. 


Now  suppose  the  researcher  failed  to  sample  this  system  at  the  correct 
interval  k  that  generated  the  system,  accidently  violating  Nyquist  by 
sampling  at  twice  the  interval  2k.  The  researcher  would  identify  the 
system  in  Equation  35  as  (see  Equation  8): 


The  cross-legged  as  well  as  autoregression  parameters  and  correlation 
coefficients  are  reversed  in  sign  in  Equation  36  compared  to  Equation  35 
In  other  words,  if  the  researcher  misjudged  the  sampling  interval  by 
sampling  at  times  1  and  3  instead  of  1  and  2,  in  this  oscillating  system 
conclusions  would  be  reversed  from  those  made  at  the  shorter  interval 
(see  Heise,  1970;  Pels  6  Lew,  1970). 

The  importance  of  sampling  intervals  is  not  limited  to 


quasi-exper imental  designs.  If  an  experimental  manipulation  induces  an 
oscillation  in  a  dependent  variable,  the  mean  response  in  the  experi¬ 
mental  group  can  oscillate  between  being  higher  and  lower  than  the 
control  group  mean,  depending  on  when  the  dependent  variable  is  sampled. 
Unfortunately,  the  dependent  variable  is  often  sampled  only  once. 
Problems  with  replication  can  stem  from  such  sampling  interval  Issues  in 
addition  to  time-invariance  issues  discussed  in  Section  2.  These  issues 
require  further  research. 

3.3.2.  Prediction  criterion.  In  general,  linear  simultaneous 
equation  models  admit  a  wide  variety  of  possible  specifications.  How¬ 
ever,  not  all  of  these  models  constitute  linear  prediction  filters. 
Linear  prediction  filters  are  a  subset  of  possible  specifications  that 
conform  to  prediction  criteria.  As  a  scientific  guideline,  the  predic¬ 
tion  criterion  is  similar  to  the  principle  of  parsimony.  Parsimony 
suggests  that  when  faced  with  alternate  explanations,  the  simplest  one 
is  accepted.  Alternate  specifications  constitute  alternate  explana¬ 
tions.  The  principle  of  prediction  says,  that  when  faced  with  alternate 
explanations,  the  explanation  that  can  predict  and  track  the  phenomenon 
is  accepted.  The  rationale  for  this  criterion  is  tied  to  theory. 
Phenomena  are  created  through  a  historical  time-related  process,  both  in 
interactivity  theory,  and,  perhaps,  in  all  psychological  theory. 
Specifications  that  can  track  and  predict  a  phenomenon  can  represent  the 
process  that  created  it,  or  be  related  to  it.  By  contrast,  a  specifica¬ 
tion  that  can't  predict  or  track  can't  represent  any  phenomenon  that  was 


created  through  time.  A  process  created  through  time  requires  time- 
lagged  coefficients  to  predict  and  track  the  process.  The  prediction 


criterion  can  be  restated  in  terms  of  a  maxim  in  modeling:  "If  a 
discrete  linear  system  can't  be  simulated  on  the  computer,  it  can't 
exist  in  nature."  Application  of  the  prediction  criterion  is  illus¬ 
trated  next  in  Sections  3.3.3.  and  3.3.4. 

3.3.3.  Single-time  path-analytic  models.  In  Table  1,  a  comparison 
is  made  between  the  filter  defined  in  Section  1.2.1.,  and  linear  path- 
analytic  models  applied  to  single  sample  data.  The  correlations  at  the 
left  in  the  table  represent  the  output  generated  by  a  stationary  histor¬ 


ical  process  shown  at  the  right.  The  coefficients  in  A  and  V  represent 
the  generative  process.  The  coefficients  in  B  and  e  represent  three  of 
the  possible  synchronous-time  specifications.  These  specifications 
correspond  in  interpretation  to  A,  with  the  exception  that  time  has  been 

/td 

left  out  of  the  path  analytic  models.  The  corresponding  elements  of  3 
and  A,  within  examples,  should  be  compared  to  see  how  well  a  model  with- 
out  the  benefit  of  time  can  represent  a  process  generated  through  time. 


The  coefficients  in  8  and  A  in  Table  1  are  obviously  very  different. 
Furthermore,  it  is  apparent  that  the  synchoronous  parameters  (B)  can't 
be  tracking  the  dynamics  of  change  in  these  examples.  Examples  2,  3, 
and  4  provide  cases  where  very  different  histories  produced  the  same 
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synchronous  correlations  and  parameters  (B) .  In  example  2,  the  signs  of 

the  coefficients  a*  in  A  were  changed  without  changing  the  synchronous 
~lj  /*•« 

correlations  or  parameters.  In  examples  3  and  4,  very  different  histories 

produced  the  same  synchronous  results.  In  example  5,  the  coefficients 

in  B  could  not  have  generated  this  stationary  system.  Due  to  a  "dampening" 

variable,  the  coefficients  in  6  are  large;  so  large,  in  fact,  that  these 

coefficients  would  produce  explosive  unstationary  change  if  they  were 

treated  as  filter  coefficients  in  A.  Synchronous  time  specifications 

**•< 

cannot  predict  or  track  because  of  missing  data — time  has  been  left  out. 
Because  of  this,  the  two  methods  will  never  match,  except  by  chance, 
even  when  they  use  the  same  estimation  technique  (e.g.,  regression,  as 
in  Table  1).  Since  the  synchronous-time  models  cannot  predict  or  track, 
they  cannot  represent  the  generative  processs  or  increase  our  under¬ 
standing  about  it.  These  conclusions  are  consistent  with  information 
theory  (Shannon  &  Ueaver,  1949).  In  information  theory,  information  is 
produced  by  change,  and  if  no  change  is  measured,  no  information  is 
generated.  Synchronous-time  models  cannot  measure  change,  and  lose 
information  as  a  consequence. 

3.3.4.  Econometric  model.  As  just  noted,  synchronous- time  linear 
models  can't  represent  histroical  processes.  Even  linear  models  that 
include  time  do  not  necessarily  represent  historical  processes  either, 
unless  they  conform  to  prediction  criteria.  The  filter  from  Section  1,2.1. 
is  compared  next  to  specifications  in  Equation  37.  Prediction  again 
forms  the  basis  for  comparison.  To  simplify  exposition,  the  model  is 
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given  for  a  two-variable,  two-wave  (one-lag)  system,  bat  conclusions 
readily  generalize  to  any  number  of  variables  and  lags: 
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F  is  subdiagonal;  and  the  covariance  of  e  is  W.  The  specifications 
in  Equation  37  are  frequently  applied  in  econometric  modeling  (Granger  & 
Newbold,  1977,  chap.  6),  and  in  panel  designs  (Duncan,  1969;  Joreskog  & 
Sorbom,  1979),  and  are  called  here  the  "econometric"  model.  A  stationary 
correlation  matrix  generated  by  A  and  V  is  shown  in  Equation  38.  The 

■**1  AM 

system  includes  two  variables  and  one  time  lag.  The  generating  A  and  V 

^  AW 

are  shown  in  Table  2,  specification  1.  The  econometric  model  is 
illustrated  by  specifications  2-8.  All  estimates  are  based  on  the 
correlation  matrix  in  Equation  38: 
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From  Equation  37  and  Table  2,  it  is  clear  that  the  econometric  model 
includes  time-lagged  relationships,  as  do  filters.  However,  the  econo¬ 
metric  model  also  includes  synchronous-time  "causal"  relationships  not 
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found  In  filters.  This  seme  kind  of  synchronous  "causal"  effect  was 


unable  to  track  change  in  the  last  section  when  history  was  excluded. 


How  well,  then,  can  synchronous-time  "causal"  relations  conform  to 


prediction  criteria,  when  time  has  been  added  to  the  model? 


Specif lcations  2,  S,  and  6  cannot  be  simulated  on  the  computer  under 


any  conditions,  which  violates  the  prediction  criterion.  Simulation  in 


a  discrete  linear  system  requires  Iteration  over  time  (see  Pelz  &  Lew, 


1970) .  Iteration  is  impossible  with  recursive,  synchronous-time  "causal" 


effects,  e.g.,  specifications  2,  5,  and  6.  Future  projections  become 


impossible:  in  order  to  forecast  the  value  of  Xt+i  *8  required, 

but  the  value  of  can't  be  estimated  without  which  is  the 


value  desired  in  the  first  place. 


The  econometric  model  specif lcations  Include  forecasts  between 


observed  variables  in  synchronous  time.  These  "forecasts"  are  not 


meaningful  in  a  literal  sense,  because  there  is  nothing  to  predict  at 


time  the  prediction  is  made:  by  the  time  ^  is  used  to  predict  in 


specification  7,  x  has  already  been  observed,  so  there  is  no  need  to 


predict  x  at  that  time.  Apparently,  the  effects  in  F  were  not  meant  to 

t  AH 


literally  represent  synchronous  effects  but  to  represent  short-term 


effects  Instead. 


One  approach  to  simulating  the  "short-term"  effects  in 
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specifications  3,  4,  7  and  8,  Table  2,  involves  moving  one  variable 
ahead  of  the  other  a  "slight  amount,"  by  computing  this  variable,  with 
its  error  added  to  it,  ahead  of  the  other  one.  This  approach  violates 
the  assumption  of  "synchronicity"  (i.e.,  common  sampling  intervals), 
both  for  the  model  and  data.  Violating  synchronicity  does  not  seem  to 
be  a  serious  problem  at  first  glance.  However,  violating  this  one 
assumption  creates  serious  if  not  insoluable  problems.  It  requires  that 
synchronous  coefficients  in  F  estimate  time-lagged  effects.  As  was 
shown  in  Table  1,  this  will  never  be  true  in  general  without  making  a 
series  of  highly  restrictive  assumptions.  The  size  of  the  "short-term" 
interval  must  be  assumed  (i.e.,  the  number  of  short  intervals  per  long 
intervals) .  In  addition  the  covariances  and  linear  parameters  must  be 
assumed  for  all  missing  short-term  intervals.  In  addition,  assumptions 
about  interpolating  between  shychronous  effects  and  lagged  effects  are 
needed.  The  assumptions  are  so  restrictive  as  to  be  almost  certainly 
untrue.  As  shown  by  Table  1,  results  are  sensitive  to  these  assumptions. 
It  is  inappropriate  to  violate  synchronicity  for  these  reasons. 

In  order  to  simulate  specifications  3,  4,  7  and  8  without  violating 
synchronicity  requires  that  forecasts  be  biased  by  dropping  error  terms. 
The  off-diagonal  elements  of  F  in  Equation  37  create  bias  for  fore- 
casting.  These  elements  create  a  linear  combination  of  errors  that  are 
needed  for  forecasting  (see  the  last  two  lines  of  Equations  IB  and  2B) . 
However,  these  errors  have  not  occurred  yet  at  the  time  the  forecast  is 
made  so  they  cannot  be  used.  As  a  consequence  the  forecast  is  biased  by 


m 


dropping  these  errors.  Specification  7  provides  an  example.  At  first 
glance,  this  specification  looks  optimal  for  forecasting,  even  better 
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than  the  filter  in  specification  1,  since  the  trace  of  W,  the  residual, 
is  smallest  here.  To  forecast  x^+^  in  specification  7,  must  be 

forecast  first,  to  enable  to  ^e  forecast  via  f^-J^t+i*  Unfortunately, 

the  error  for  (e^t^)  has  not  occurred  yet  at  time  JL,  when  the 

forecast  is  made,  so  it  must  be  dropped  in  making  the  forecast  to  2t+l* 


As  a  consequence,  the  forecast  to  x.t+^  Is  biased  by  f^2e  t »  w^lch  biases 
2 


the  residual,  f^  v^2  *  *145.  Since  this  is  precisely  the  amount  by 
which  the  residual  in  specification  7  is  smaller  than  in  1,  "improved" 
prediction  in  this  specification  is  due  totally  to  prediction  bias.  The 
error  w^  in  specification  7  is  biased  in  the  sense  that  it  does  not 
represent  the  total  amount  of  prediction  error  in  the  system  as  it 


purports  to  do.  Since  the  parameters  in  F  and  At  are  all  estimated  in 

■*w 


relation  to  biased  errors,  the  latter  parameters  are  biased  for  fore¬ 
casting  too.  The  transformation  equations  between  the  filter  in 
specification  1  (which  can  be  used  to  forecast),  and  the  econometric 
model  in  specifications  2-8  are  found  in  Appendix  B.  The  nature  of 
forecasting  biases  is  illustrated  by  the  transformation  equations.  For 
example,  from  the  last  line  of  Equation  IB  and  from  Equation  5B,  the 
residual  w^  in  specification  7  can  be  written  as. 


-11  *  -11  '  -12  -22  *  -11  “  (-12/-22)  -22' 


(39) 
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In  Equation  39  w  and  £  are  from  specification  7  and  V  is  from  specifi- 
cation  1  and  Equation  11.  Forecast  bias  is  apparent  in  Equation  39. 

In  attempting  to  simulate  specification  7  over  time,  values  of  w^  in 
Equation  39  must  be  set  to  zero  at  time  t+1  when  tracking  or  forecasting 
occurs,  which  means  w^  will  become  equal  to  over  time.  When  a 
residual  changes,  the  whole  system  changes,  i.e.,  parameters  in  F,  At, 

AM  A* 

r(o)r(i,  also  change.  This  means  that  the  forecast  bias  that  accrues 
from  dropping  future  errors,  makes  it  impossible  to  simulate  econometric 
model  specifications  3,  4,  7  and  8,  and  still  maintain  the  same  correla¬ 
tion  matrix  in  Equation  38  and  parameters.  Furthermore,  it  is  impossible 
to  eliminate  this  forecast  bias  without  violating  the  assumption  of 
synchronicity  with  its  attendant  serious  problems.  Since  none  of  the 
econometric  specifications  can  be  properly  simulated,  none  of  them 
conform  to  the  prediction  criterion. 

An  econometric  model  may  instantiate  theory  one  way  via  specifica¬ 
tions  2-8,  and  predict  another,  via  specification  1;  however,  this  dual 
system  is  not  consistent  with  the  principle  of  prediction.  Applying  the 
prediction  criterion  to  Table  2,  specifications  1  alone  can  predict  and 
track.  As  a  consequence,  this  specification  alone  has  the  potential  to 
represent,  and  increase  our  understanding  of,  processes  created  through 
time.  Specifications  2-8  suffer  from  the  same  defect  as  do  the 
synchronous-time  path-analytic  models — missing  data.  In  order  to 
measure  short  term  effects,  the  system  should  have  been  sampled  at 
appropriate  short-term  intervals. 


Without  the  prediction  principle,  econometric  models  have  fared 
poorly.  Very  simple  autoregressive  filters  have  been  able  to  forecast 
as  well  or  better  than  very  complex  econometric  models  (Granger  &  New- 


bold,  1977,  chap.  8). 


4.1.  Model  Identification 


4.  Parsimony 


The  principle  of  parsimony  is  defined  by  refusing  to  multiply 
complexity  beyond  necessity.  The  most  common  application  of  this 
principle  to  linear  models  involves  its  use  as  a  selection  criterion 
among  alternate  specifications.  The  specification  that  "fits  best"  with 
fewest  parameters  is  selected  from  among  the  alternatives,  other  factors 
being  equal  (see  Joreskog  &  Sorbom,  1979).  According  to  Akaike  (1974), 
there  is  a  relationship  between  the  number  of  parameters  in  a  model,  and 
the  predictive  power  of  the  model.  An  Information  criterion  (AIC)  is 
used  for  purposes  of  model  identification.  A  curvilinear  relationship 
between  forecasting  accuracy  and  simplicity  is  identified  in  this 
criterion.  Forecasts  improve  as  parameters  increase,  up  to  a  point, 
beyond  which  limited  samples  can  no  longer  support  accurate  parameter 
estimates,  and  then  additional  parameters  decrease  forecasting  accuracy. 

A  related  application  of  parsimony  involves  refusing  to  multiply 
possible  alternative  specifications  beyond  necessity.  Model  identifica¬ 
tion  is  a  difficult  problem,  however  (Learner,  1978).  Model  identifica¬ 
tion  is  a  current  topic  of  intense  research  (El-Sherief  &  Sinha,  1982; 
Lee,  1983).  A  goal  is  to  identify  models  in  ways  that  simultaneously 
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conform  to  more  than  one  scientific  criterion,  like  instantiating  theory 
where  it  exists,  as  well  as  maximizing  prediction  and  parsimony. 

4,2.  Comparison 

4.2.1.  Synchronous-time  models.  Synchronous- time  path-analytic 
models  admit  a  great  variety  of  possible  specifications,  due  to  the  loss 
of  ordering  information  that  time  provides.  The  number  of  possible 
specifications  in  these  models  is  given  by, 


m  /  m  \ 

Jo(j 


where  m  ■  £(£-1),  £  referring  to  the  number  of  synchronous  variables. 

The  number  of  identifiable,  and  therefore  estimable  specifications,  in 
Equation  40  can  be  found  by  substituting  (£-1)  for  m  in  Equation  40. 
Using  Equation  40,  it  is  clear  there  are  64  possible  synchronous 
specifications  between  the  three  synchronous  variables  in  Table  1,  42  of 
which  are  identifiable.  With  four  synchronous  variables,  there  are  4096 
possible  specifications,  2510  of  which  are  identifiable.  All  of  these 
possible  specifications  can  be  ruled  out  using  the  prediction  criterion 
(see  Section  3.3.3.).  Furthermore,  there  is  no  loss  in  information  in 
doing  so,  since  the  possible  interpretations  of  synchronous  specifica¬ 


tions  all  have  an  analogous  time-related  interpretation  that  can  be 
taken  directly  from  A  in  Equation  6.  To  illustrate,  A  from  example  1, 

At*. 

Table  1,  shows  an  "intervening  variable"  relationship  between  ^  and  z_ 
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via  x.  The  alternate  interpretation  due  to  synchronous  parameters  in 
example  1  of  "spurious"  correlation,  was  ruled  out  by  the  prediction 
criterion . 


Similarly,  there  is  an  exponentially  expanding  number  of  possible 
specifications  in  the  econometric  model  that  can  be  ruled  out  by  the 
prediction  criterion.  No  information  is  lost  beyond  what  is  available 

in  A  (see  Section  3. 3. A.).  In  this  latter  model,  short-term  effects 

Am 

must  be  measured  if  required  by  theory. 

In  spite  of  the  ability  to  rule  out  large  classes  of  possible 
specifications  using  the  prediction  criterion,  the  identification  of 
filter  models  is  by  no  means  unique.  The  order  of  an  "autoregression" 
model,  or  number  of  lags,  must  be  identified.  Furthermore,  there  is  a 
large  class  of  "latent"  or  "unobserved"  variable  models  that  remain  as 
possible  specifications. 

A. 2. 2.  Cross-lagged  correlation  model  of  spuriousness.  Correla¬ 
tions  and  covariances  are  under identified  with  respect  to  the  possible 
structures  that  could  have  created  them  (Mulaik,  1972,  chap.  13).  It 
is  possible  to  create  a  given  correlation  structure  through  simulation 
many  different  ways,  including  the  use  of  unobserved  or  latent  variables. 
The  attempt  to  rule  out  latent  or  unobserved  variable  specifications  has 
been  defined  in  terms  of  "ruling  out  spuriousness"  (Kenny,  1973,  1975b). 
The  issue  of  "causal  predominance"  in  the  cross-lag  model  is  not  the 
issue  here  (see  Rogosa,  1980) .  Currently,  it  is  not  possible  to  rule 
out  spuriousness  in  the  general  sense  of  ruling  out  all  possible  latent 
variable  specifications.  However,  Kenny  (1973,  1975b)  defined  ruling 


out  spuriousness  in  terms  of  ruling  out  multiple,  orthogonal,  synchro¬ 
nous  latent  variables  as  the  sole  cause  of  an  observed  correlation 
matrix.  Cross-lagged  correlational  differences  do  operate  to  rule  out 
spuriousness  in  this  narrowly  defined  sense;  but  not  in  a  more  general 
sense.  To  illustrate,  the  cross-lagged  model  of  spuriousness  can  be 
written  as. 
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In  Equation  41  x^  and  are  observed  variables;  and  are  two 

latent  unobserved  variables;  B  is  a  matrix  of  loadings  from  latent  to 

observed  variables;  d^  and  d^  are  autoregression  coefficients  for  the 

latent  variables; ^ezt  are  white  noise  processes  that  drive  the  system, 

and  ®xt  is  a  form  of  "measuremenl"  error  (see  Section  1.2.3.).  The 

representation  in  Equation  41  is  the  simplest  one  in  which  elements  of  B 

are  "perfectly"  stationary  and  do  not  adapt.  The  latent  variables  are 

uncorrelated,  i.e.,  E(e  e'  )  *  U  ■  0. 
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The  canonical  variable  transformation  of  the  filter  in  Section  1.2.1. 
is  shown  in  Appendix  C.  This  transformation  is  identical  to  the  model 
of  spuriousness  in  Equation  41,  with  two  exceptions.  The  canonical 
variable  transformation  is  a  special  case  of  Equation  41  in  which  "measure¬ 
ment"  error  e  ■  J3- -which  does  not  affect  the  spuriousness  argument. 
However,  the  second  exception  is  important.  The  canonical  variables  are 
allowed  to  be  correlated  as  they  almost  certainly  would  be  in  nature: 
EC®,.®!,.)  m  U  i  0.  When  the  latent  variables  are  allowed  to  be  correlated, 
then  a  number  of  variables  in  synchronous  time  can  be  the  sole  cause  of 
an  observed  correlation  matrix  (see  Appendix  C) .  Furthermore,  in  contrast 
to  the  econometric  model,  the  canonical  variable  transformation  can  be 
used  to  track  and  forecast,  so  it  conforms  to  the  prediction  criterion. 
Therefore,  cross-lagged  correlation  cannot  rule  out  spuriousness  in  this 
slightly  more  general  sense. 

The  correlation  matrix  in  Equation  38  provides  an  example.  Equation  2 
and  specification  1,  Table  2,  provide  the  customary  explanation  for  this 
correlation  matrix  in  terms  of  observed  variables.  The  canonical 
variable  transformation  in  Appendix  C  provides  an  alternative  explanation. 
Applying  Equations  4C,  5C  and  8C  to  the  example  in  Equation  38, 
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A  and  V  from  Equations  6  and  11  can  be  partitioned  to  include  latent 
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The  matrices  from  Equation  43  can  be  used  In  Equations  7  and  8  to 
generate  the  observed  and  latent  correlation  matrices.  In  spite  of  a 
cross-lagged  correlation  difference  in  Equation  38,  the  correlation 
matrix  in  Equation  38  can  be  produced  perfectly  by  two  correlated, 
unobserved,  latent  variables  in  synchronous  time  (see  Equations  42,  43, 


9C,  IOC). 

I  9 

I 

The  canonical  variable  transformation  becomes  complex  when  the 
|  eigenstructure  of  A  is  complex.  The  canonical  variable  transformation 

I  AM 

cannot  be  considered  an  alternate  explanation  if  latent  variables  and 

! 

parameters  are  limited  to  real  numbers,  but  the  eigenstructure  of  A  is 
complex.  It  is  possible  to  rule  out  spuriousness  in  the  sense  of  ruling 
out  multiple,  correlated,  latent  variables  in  synchronous  time,  when  the 
roots  of  A  are  complex  (as  they  were  in  data  from  the  Example  Section). 

|  However,  it  is  still  not  possible  to  rule  out  spuriousness  in  a  general 

I 

sense,  since  multiple  latent  variables  at  multiple  time  lags  could 

I 

|  theoretically  reproduce  any  correlation  or  covariance  matrix. 

Example 

A  sample  composed  of  39  combat  companies  in  the  U.  S.  Army  was 
used.  Companies  are  organizational  units  of  approximately  125  soldiers 
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nested  within  the  larger  organizational  hierarchy  shown  In  Equation  28. 
Companies  constitute  the  unit  of  analysis  here.  Approximately  18  enlisted 
men,  grades  El  through  E4 ,  were  randomly  sampled  from  each  company  on 
three  occasions  at  10-week  intervals.  Sampling  took  place  without 
replacement.  Administrative  record  data  were  also  collected  for  the 
same  periods,  including  frequency  of  promotion  to  grades  E3,  E4,  and  E5 
for  lower  enlisted  soldiers.  Frequency  of  promotion  was  unrelated  to 
the  numbers  eligible  for  promotion  within  each  company,  so  frequency 
counts  were  used.  Frequency  of  promotion  (Variable  1)  plus  three  survey 
scales  were  selected  to  illustrate  application  of  the  filtering  method¬ 
ology.  Scale  1  was  labeled  Goal  Orientation  (Variables  and  X3)  ; 

Scale  2,  Intergroup  Harmony  (Variables  x^,  x,.  and  ;  and  Scale  3, 

Enlisted  Unity  (variables  x^  and  Xp) . 

These  data  were  roughly  stationary,  with  the  possible  exception  of 
time-varying  measurement  error  for  Variable  1  and  Scales  2  and  3.  Means 
and  standard  deviations  for  the  eight  variables  at  three  time  intervals 
are  given  in  Table  3.  According  to  the  model  in  Section  1.2.,  means  and 
standard  deviations  do  not  vary  as  a  function  of  time.  Synchronization 
or  "reliability"  estimates  using  Equation  30  (MS^  *  MS^.  MS^^^  *  MS„) 
were  computed  to  represent  homogeneity  of  responses  within  companies. 

These  measures  are  expected  to  be  stationary  as  a  function  of  time. 

They  are  related  to  reliability  in  the  sense  of  sampling  soldiers  to 
estimate  total  company  means,  but  underestimate  true  reliability  because 
(a)  response  sets  have  not  been  filtered  out  yet,  and  (b)  sampling 


fractions  for  snail  finite  populations  were  not  used.  For  lags  k  ■  0, 

1  and  2,  synchronization  measures  were  .33,  .34  and  .35  for  Scale  1; 
.39,  .21  and  .50  for  Scale  2;  and  .36,  .30  and  .57  for  Scale  3.  The 
covariance  matrix  between  eight  variables  at  three  intervals  is  roughly 
stationary.  Least  squares  estimators  of  a  block  Toeplitz  covariance 
matrix  were  made  by  averaging  the  three  synchronous  blocks  (k  -  0)  and 
two,  lag-one  (k  ■  1)  blocks.  The  resulting  block  Toeplitz  matrix  was 
compared  to  the  original  using  a  chi-square  goodness  of  fit  test  (see 
Browne,  1977;  Joreskog  &  Sorbom,  1979),  X2  (300)  ■  326.7,  £«*.5.1 
Maximum  likelihood  estimates  of  block  Toeplitz  matrices  are  possible 
(see  Section  2.1.),  but  least  squares  estimators  are  sufficiently 
accurate  for  illustrative  purposes  (Steiger,  1980). 


Table  3 

Means  and  Standard  Deviations  for  Three  Vares 


lag  k 

*1 

*2 

-3 

u 

*5 

26 

*7 

28 

0 

12.6 

5.7 

6.4 

5.1 

*•3 

4.2 

5.5 

5.4 

1 

9.6 

5.6 

6.2 

4.9 

4.0 

4.1 

5.4 

5.4 

2 

7.3 

5.6 

6.3 

5.0 

4.1 

4.1 

5.4 

5.3 

Standard  Deviations 


0 

5.36 

.54 

.46 

.81 

.64 

.62 

.57 

.48 

1 

4.86 

.55 

.46 

.73 

.68 

.60 

.52 

.45 

2 

3-92 

.54 

.44 

.90 

.67 

.67 

.61 

.58 

Note,  x.  ■  promotion  frequency.  Survey  scales  x,  -  Xq  were  rated  on  8-point 
scales  and  coded  so  that  larger  numbers  were  associated  with  positive  responses. 

1  Covariance  and  correlation  goodness-of-f it  tests  are  sensitive  to  an  assumption 
of  multivariate  normality. 


The  time-series  factor  analysis  model  from  Section  1.2.3.  was 
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applied  to  these  data.  The  block  Toeplitz  covariance  matrix  was 
standardized,  since  factor  analysis  is  customarily  applied  to  correla¬ 
tion  matrices.  All  parameter  estimates  were  based  on  the  standardized 
block  Toeplitz  matrix.  The  original  correlations  between  variables  at 
three  intervals  are  given,  along  with  the  expected  correlations  based  on 
the  time-series  factor  analysis  model,  in  Table  4.  The  expected  correla¬ 
tions  were  obtained  by  solving  again  for  the  "observed"  correlations  in 

terms  of  the  latent  correlations  in  Equation  25.  The  expected  correlations 
were  compared  to  the  observed  correlations.  The  chi-square  goodness-of- 

fit  test  was  again  approximately  equal  to  the  degrees  of  freedom,  £$^.5. 
There  was  a  close  fit  between  the  standardized  block  Toeplitz  matrix  and 
the  expected  correlations  in  Table  4,  p  <  .01.  Estimates  of  B  and  M 
were  obtained  by  subjecting  the  synchronous  section  of  the  block  Toeplitz 
matrix  (Jc  »  0)  to  common  factor  analysis,  using  a  principal  axes  solution 
with  Iterations  and  varimax  rotation.  The  first  variable,  promotion 
frequency,  was  not  treated  as  latent.  Scales  1,  2,  and  3  were  defined 
by  the  latent  variables  taken  from  B: 
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Estimates  of  M  were  obtained  from  B  In  the  customary  manner.  Finally, 
latent  correlations  and  parameters  and  ^  are  provided  in  Table  5. 

The  results  in  Table  S  reflect  a  highly  dynamic  oscillating  system. 
The  period  of  oscillation  can  be  determined  from  the  angle  of  the  complex 
conjugate  eigenvalues  (roots)  of  (see  Chow,  1975,  pp.  27-30,  57-58). 
The  relative  amplitude  of  effects  is  a  function  of  the  absolute  value  of 
Che  roots.  Four  different  periods  of  oscillation  were  represented  in 
the  roots  of  A^,  plus  exponential  decay  stemming  from  one  large  positive 
real  root.  Listed  in  order  of  increasing  amplitude,  oscillation  was 
found  for  periods  of  5,  11,  27,  and  23  months.  The  latter  period  corre¬ 
sponds  roughly  to  the  average  tenure  of  enlisted  soliders  in  a  company. 
Promotions  appear  to  be  part  of  the  latter  cycle.  A  cycle  of  24  months 
appears  when  comparing  promotions  with  a  composite  scale  (created  by 
averaging  within-scale  items  first  and  then  averaging  scales).  A  full 
multivariate  frequence  domain  transformation.  Including  phase  lag 
relationships,  is  needed  (see  Friedlander,  1982b).  Such  transformations 
are  the  topic  of  current  research. 

In  order  to  pick  up  the  dynamics  of  change,  it  was  important  to 
include  the  third  sampling  time  in  this  system.  The  intermediate 
sampling  time  helps  to  rule  out  aliasing  effects  due  to  violating 
the  Nyquist  frequency,  at  least  for  the  longer  period  oscillations.  The 


m 
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number  of  sampling  intervals  needs  to  be  Increased  to  eliminate  concern 
over  aliasing  for  the  shorter  period  oscillations  (e.g.,  five  months). 

The  complex  conjugate  roots  of  mean  that  spuriousness  can  be 
ruled  out  in  a  limited  sense:  l.e.,  multiple  correlated  latent  variables 
could  not  have  produced  the  observed  correlation  matrix  entirely  (see 
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Table  5 
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Note.  z_1  a  promotion  frequency;  a  Goal  Orientation;  Intergroup  Harmony;  a 
Enlisted  Unity.  All  entries  should  be  multiplied  by  .01.  The  eigenvalues  of  A 

z 

• 

are:  (a)  .65  ♦  .42i,  (b)  .72,  (c)  .54  ♦  .32i,  (d)  .22  ♦  .48i,  (e)  -.22. 
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Section  4.2.2.).  Similarly,  lack  of  stationarity  in  measurement  error 
at  each  time  point  could  not  account  entirely  for  the  observed  correla¬ 
tion  pattern,  although  it  could  have  had  an  influence.  Allowing  measure¬ 
ment  error  to  adapt  would  improve  the  fit  to  real  data  (see  Section  2.2.). 

The  data  in  Table  5  suggest  that  good  interpersonal  relations  led 
to  high  promotion  rates,  while  high  promotion  rates  produced  a  negative 
"sour  grapes"  reaction  on  a  variety  of  scales.  The  expectation  of 
replicating  these  results  is  improved  by  the  fact  that  relationships  are 
roughly  stationary  in  a  first  order  sense.  Results  are  not  Inconsistent 
with  evidence  that  promotions  are  rewarding.  Promotions  are  rewarding, 
but  rewarding  at  an  individual  level  to  the  persons  promoted.  At  the 
group  level,  many  eligible  persons  are  not  promoted  for  each  one  who  is, 
creating  disappointment  and  conflict.  The  principle  in  Section  1.2.4. 
is  illustrated  here:  Results  from  one  level  of  analysis  often  will  not 
be  the  same  as  results  from  another  level.  In  another  noticeable  rela¬ 
tionship,  Intergroup  Harmony  is  driving  an  oscillation  in  Goal  Orienta¬ 
tion  (effort  toward  achieving  company  effectiveness). 

These  results  also  illustrate  the  principle  of  bootstrapping 
through  levels  of  theory  (see  Section  1.1.).  A  measurement  model  was 
needed  prior  to  estimating  a  historical  model.  The  historical  model  was 
needed  to  understand  the  dynamics  of  intergroup  or  interpersonal  inter¬ 
action.  Finally,  understanding  the  dynamics  of  interaction  are  natural 
prerequisites  to  planning  effective  transformational  change.  The 
probability  of  increasing  group  productivity  is  improved  by  understanding 
system  dynamics  as  shown  in  linear  prediction  filters  (e.g.,  . 


Discussion 


Me  have  argued  that  failure  to  appropriately  test  theory  leads  to 
the  predominance  of  ideologically-based  content  in  the  field.  Ideo¬ 
logical  concent  is  defined  as  untested  theory.  This  problem  can  arise 
from  an  inability  to  appropriately  test  theory.  A  brief  review  of  some 
commonly  used  methods  in  the  field  showed  a  number  of  serious  problems 
im  the  application  of  the  scientific  method,  and  a  more  exhaustive 
review  could  undoubtedly  uncover  additional  problems.  Ideological 
content  is,  then,  a  problem.  Interactivity  theory  attacks  this  problem 
by  attempting  to  improve  the  application  of  the  scientific  method.  An 
approach  that  seems  particularly  promising  is  linear  prediction  filter 
methodology.  These  filters  have  been  successfully  applied  to  many  high 
technology  problems,  and  are  appropriate  for  application  to  interactive 
human  environments.  There  is  a  large  technically  sophisticated  tradi¬ 
tion  and  literature  in  this  area.  Unfortunately,  this  tradition  has 
been  frequently  ignored,  perhaps  because  it  appears  Irrelevant  to 
psychological  problems.  Although  many  methods  need  to  be  adapted  to 
meet  the  requirement  of  psychological  theory,  the  relevance  of  this 
tradition  to  psychological  problems  has  been  demonstrated  here. 

Many  important  topics  have  not  been  covered  here.  What  is  covered, 
however,  provides  a  tutorial  for  approaching  the  electronics  engineering 
and  economics  literature  on  statistical  aspects  of  filtering.  Additional 
research  and  study  is  needed  on  such  important  topics  as  transformational 
change  (see  Chow,  1981),  adaptive  systems  (see  Friedlander,  1982a),  and 
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higher  order  stationarity .  In  addition,  estimation  theory  and  statistical 
tests  were  not  discussed  in  the  context  of  filters.  A  variety  of  research 
issues  exist  here,  e.g.:  (a)  behavior  tests  of  overall  system  output, 

versus  significance  tests  for  single  equations  (Mass  &  Senge,  1978); 

(b)  sensitivity  of  goodness-of-f it  chi-square  tests  to  the  multivariate 
normality  assumption  (see  Joreskog  &  Sorbom,  1979);  (c)  distribution- 
free  tests  using  "bootstrap"  methods  (Dlaconis  &  Efron,  1983);  and 
(d)  conflict  among  root-based  tests  (Berndt  6  Savin,  1977;  Kohler,  Mote  3). 

Placing  factor  analysis  in  the  context  of  filters  means  the  resulting 
filter  must  forecast  individual  cases.  Since  the  common  factor  analyses 
model  is  under identified,  factor  scores  must  be  estimated  rather  than 
identified  exactly.  Traditional  methods  for  estimating  factor  scores 
(see  Mulaik,  1982,  chap.  13)  do  not  seem  satisfactory  in  the  context  of 
filters.  Again,  further  research  is  required. 
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APPENDIX  A 
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in  Equation  7  can  be  written  in  closed  form  that  excludes 
infinite  series.  This  can  be  accomplished  by  using  the  following 
general  identity  (see  Browne,  1977;  Equation  6): 


vec(RST')  *  (T  •  R)vecS,  where 

JM  ** 


R  and  T  are  of  order  m  x  n,  S  is  of  order  n  x  n;  and  •  refers  to  the 

>M  —  —  yfV  —  — 

Direct  or  Kronecker  product.  Equation  1A  can  be  used  to  rewrite 
Equation  11  as. 


vecV  -  vec  r,ft\  -  (A  •  A)vec  I”,-. ,  where 
"*•  (07  am  am  (07 


vec  refers  to  an  n  x  1  column  vector  created  by  stacking,  in  order  from 
1  to  n,  the  n  columns  of  an  n  x  n  matrix.  The  value  ri  is  defined  in 
Equation  6.  Factoring,  and  solving  for  T^j  , 


vec  r/ft\  -  (I  -  A  •  A)  vecV. 

(07  «  Am  Am  AM 


Unfortunately,  this  solution  requires  inverting  a  large  matrix.  How¬ 
ever,  an  alternate  expression  for  in  closed  form  is  provided  by  the 

eigenstructure  of  A,  as  shown  by  Equations  7C  and  9C,  Appendix  C,  and 
Chow  (1975,  chap.  3): 


r.V.V' 


r(0)  -  JJj(  l-conjgU^Xp-  uij)JB' 


£  Is  the  matrix  of  eigenvectors  of  ^A,  A^  and  Xj^  are  elements  of  ^D,  the 
diagonal  matrix  of  eigenvalues  of  _A  (see  Equation  6),  ui^j  are  elements 
of  the  residual  covariance  matrix  JJ, (see  Equation  5C)  in  canonical 
variable  form,  and  conjg  refers  to  taking  the  complex  conjugate  when 
is  complex.  In  addition  to  Equation  4A,  the  lattice  filter  provides 
an  efficient  formula  for  the  regeneration  of  covariance  matrices  in 
closed  form  using  linear  parameters  and  residuals  (see  Friedlander,  1982a). 
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APPENDIX  B 


The  transformations  between  the  filter  in  Section  1.2.1.  and  the 
econometric  model  in  Section  3.3.4.  are  defined  by  the  equations  in  this 
appendix.  All  the  econometric  model  specifications  can  be  transformed 
into  the  filter  using  the  following  equations.  Let  G  *  1  -  F.  Then, 

<***  4M  AM 


=  G_1AtX  ,  +  G-1e  , 

<*v»  4m  *»t-l  m  m  Wt 


A  =  G_1At, 

/•*  A* 

v_  *  G~^e  , 

AM  *»Wt 

V  =  g-H?g,_1  . 

AAA  AAJ  .  . 

rw*  1  ^  •  1 


In  Equation  IB  W  is  the  covariance  of  residuals,  e  e'  .  Other  terms 
are  defined  in  Sections  1.2.1.  and  3.3.4. 

Conversely,  the  transformation  from  the  filter  to  all  econometric 
specifications  involve  the  following  equations. 


At  -  GA 

M  *»> 


e 

*»  wt 


Gv 


W  *  GVG'. 


It  is  possible  to  solve  for  the  elements  of  G  (or  F)  from  the  elements 
of  A  as  follows.  Solve  for  v  y  in  the  second  line  of  Equation  2f 

AAA 


( 3  B ) 


m 


Vl  ’  <2i  '  -21  '  Tt1  -22- 

Substitute  the  result  into  Equation  2,  line  1,  and  collect  terms: 

*t  “  <ll2/^22)\  +  U11  "  a12a21/a22)%-l  "  (^12/^22)%  +  %t  * 

In  Equation  4B  ^  ^  becomes  zero,  and  f ^  *  -gj^  *  a12^a22‘  ®t*ier 
elements  of  F  and  G  can  be  solved  analogously.  Elements  of  G  can  also 

/*%i  ^ 

be  obtained  from  V,  by  rewriting  the  last  line  of  Equation  2B  as  (see 
Equation  1A) , 


vecW  *  (G  •  G)vecV. 

**  ****** 


(SB) 


Off-diagonal  elements  of  W  can  be  set  to  zero.  Particular  elements  of  G 
can  then  be  solved  in  terms  of  elements  of  V.  Using  Equations  2B,  4B, 
and  5B,  any  of  the  parameters  from  the  econometric  specifications  in 
Table  2  can  be  written  in  terms  of  filter  coefficients  (specification  1) . 
For  example,  a^  from  specification  5  is, 


(-12  -22  "  -12i22-12)/<i22-ll 


-  —12—12^ 


+  — 22  ‘ 


(6B) 


APPENDIX  C 


The  transformation  between  the  filter  in  Section  1.2.1.  and  its 
latent  canonical  variable  representation  is  given  here  (see  Chow,  1975, 
chap.  3).  The  canonical  variable  representation  is  similar  to  the 
cross-lagged  correlation  model  of  spuriousness  discussed  in  Section  4.2.2. 

A  canonical  variable  is  defined  by: 

Z  »  B-1X  .  (1C) 


B  is  the  eigenvector  matrix  from  the  eigenstructure  of  A.  A  and  X  are 
defined  in  Equation  6.  The  following  relationships  follow  from  this 
definition: 


■J£f 


(2C) 


Jfzt 


B~V 


(3C) 


DZ 


,  +  e 

t-1  tmZt 


(4C) 


The  term  v  is  defined  in  Equation  6,  and  e  in  Equation  41.  D  is 
— t  — zt  ’  **♦ 

the  diagonal  matrix  of  eigenvalues  from  A.  Using  Equation  3C  the 
covariance  of  latent  canonical  residuals  becomes: 


1  e  .e' 

**  ZtmZt 


B-1VB* 


(5C) 


Using  Equation  4C  Che  synchronous  covariance  of  latent  canonical 
variables  becomes. 


ri(0)  -Jt.il  ■-Dri(0)i.'  +  “■ 


Using  Equation  1A,  can  be  rewritten  as. 


-1 


vecr*(o>  “  11  “  conj8  vecS»' 

In  Equation  (7C)  conjg  refers  to  the  complex  conjugate  of  the  matrix  I). 
This  operation  affects  complex,  but  not  real  entries  in  D. 

The  indeterminacy  in  the  eigenvector  matrix  B  can  be  eliminated  by 

AM 

standardizing  the  latent  covariance  matrix  T  ....  This  can  be  accom- 
plished  by. 


~£  "  d iag  1  Fx (0)  d Ug  1  Fz (0)  ^ • 


(6C) 


(7C) 


(8C) 


vhereJB^  represent  standardized  coefficients,  and  d lag  represents 
diagonal  elements  of  the  respective  matrices.  In  order  to  standardize 
JJ»  ■u*t  be  computed  by  substituting  B  for  B  in  Equation  5C.  In 
order  to  standardize  1^^,  ^x#(q)  Bu8t  be  computed  by  substituting  vec 
(or  vec  JJ  in  Equation  7C.  Finally,  the  observed  correlation  matrix 
can  be  written  as, 

r,<o>  ■  idi  -  i.ri.(o)i; 

r«(w  ■  .mu  •  i/ri.(o)';- 


(90 

(IOC) 
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